Class cascading.flow.hadoop.FlowPlatformTest

all > cascading.flow.hadoop > FlowPlatformTest

tests

failures

ignored

3m55.08s

duration

100%

successful

Tests
Standard output
Standard error

Tests

Test	Duration	Result
testCopyConfig	23.415s	passed
testFailedSerialization	0.037s	passed
testFailingListenerCompleted	1m9.48s	passed
testFailingListenerStarting	0.058s	passed
testFailingListenerStopping	35.447s	passed
testFailingListenerThrowable	1m10.98s	passed
testFlowID	0.038s	passed
testLocalModeSink	0.031s	passed
testLocalModeSource	0.044s	passed
testNotLocalMode	0.037s	passed
testStartStopRace	0.032s	passed
testStop	35.488s	passed

Standard output

2015-02-12 16:05:54,419 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-02-12 16:05:54,452 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-02-12 16:05:54,452 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.flow.hadoop.FlowPlatformTest
2015-02-12 16:05:54,467 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(117)) - using cluster
2015-02-12 16:05:55,092 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-02-12 16:05:55,140 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(770)) - No KeyProvider found.
2015-02-12 16:05:55,158 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(782)) - fsLock is fair:true
2015-02-12 16:05:55,239 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1022)) - hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping
2015-02-12 16:05:55,239 INFO  blockmanagement.DatanodeManager (DatanodeManager.java:<init>(232)) - dfs.block.invalidate.limit=1000
2015-02-12 16:05:55,240 INFO  blockmanagement.DatanodeManager (DatanodeManager.java:<init>(238)) - dfs.namenode.datanode.registration.ip-hostname-check=true
2015-02-12 16:05:55,242 INFO  blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(71)) - dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
2015-02-12 16:05:55,243 INFO  blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(76)) - The block deletion will start around 2015 Feb 12 16:05:55
2015-02-12 16:05:55,247 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlocksMap
2015-02-12 16:05:55,247 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 16:05:55,250 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 2.0% max memory 672 MB = 13.4 MB
2015-02-12 16:05:55,250 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^21 = 2097152 entries
2015-02-12 16:05:55,264 INFO  blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(356)) - dfs.block.access.token.enable=false
2015-02-12 16:05:55,265 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(341)) - defaultReplication         = 3
2015-02-12 16:05:55,266 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(342)) - maxReplication             = 512
2015-02-12 16:05:55,267 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(343)) - minReplication             = 1
2015-02-12 16:05:55,267 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(344)) - maxReplicationStreams      = 2
2015-02-12 16:05:55,267 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(345)) - shouldCheckForEnoughRacks  = false
2015-02-12 16:05:55,268 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(346)) - replicationRecheckInterval = 3000
2015-02-12 16:05:55,268 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(347)) - encryptDataTransfer        = false
2015-02-12 16:05:55,269 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(348)) - maxNumBlocksToLog          = 1000
2015-02-12 16:05:55,278 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(803)) - fsOwner             = soberoi (auth:SIMPLE)
2015-02-12 16:05:55,280 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(804)) - supergroup          = supergroup
2015-02-12 16:05:55,293 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(805)) - isPermissionEnabled = true
2015-02-12 16:05:55,294 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(816)) - HA Enabled: false
2015-02-12 16:05:55,297 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(853)) - Append Enabled: true
2015-02-12 16:05:55,519 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map INodeMap
2015-02-12 16:05:55,520 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 16:05:55,520 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 1.0% max memory 672 MB = 6.7 MB
2015-02-12 16:05:55,521 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^20 = 1048576 entries
2015-02-12 16:05:55,521 INFO  namenode.NameNode (FSDirectory.java:<init>(232)) - Caching file names occuring more than 10 times
2015-02-12 16:05:55,527 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map cachedBlocks
2015-02-12 16:05:55,528 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 16:05:55,528 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.25% max memory 672 MB = 1.7 MB
2015-02-12 16:05:55,528 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^18 = 262144 entries
2015-02-12 16:05:55,530 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(5455)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2015-02-12 16:05:55,530 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(5456)) - dfs.namenode.safemode.min.datanodes = 0
2015-02-12 16:05:55,530 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(5457)) - dfs.namenode.safemode.extension     = 0
2015-02-12 16:05:55,532 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(942)) - Retry cache on namenode is enabled
2015-02-12 16:05:55,532 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(950)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2015-02-12 16:05:55,534 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map NameNodeRetryCache
2015-02-12 16:05:55,534 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 16:05:55,535 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.029999999329447746% max memory 672 MB = 206.4 KB
2015-02-12 16:05:55,535 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^15 = 32768 entries
2015-02-12 16:05:55,540 INFO  namenode.NNConf (NNConf.java:<init>(62)) - ACLs enabled? false
2015-02-12 16:05:55,540 INFO  namenode.NNConf (NNConf.java:<init>(66)) - XAttrs enabled? true
2015-02-12 16:05:55,541 INFO  namenode.NNConf (NNConf.java:<init>(74)) - Maximum size of an xattr: 16384
2015-02-12 16:05:55,595 INFO  namenode.FSImage (FSImage.java:format(145)) - Allocated new BlockPoolId: BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:55,605 INFO  common.Storage (NNStorage.java:format(550)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/name1 has been successfully formatted.
2015-02-12 16:05:55,606 INFO  common.Storage (NNStorage.java:format(550)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/name2 has been successfully formatted.
2015-02-12 16:05:55,701 INFO  namenode.NNStorageRetentionManager (NNStorageRetentionManager.java:getImageTxIdToRetain(203)) - Going to retain 1 images with txid >= 0
2015-02-12 16:05:55,702 INFO  namenode.NameNode (NameNode.java:createNameNode(1356)) - createNameNode []
2015-02-12 16:05:55,741 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-02-12 16:05:55,815 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:startTimer(356)) - Scheduled snapshot period at 10 second(s).
2015-02-12 16:05:55,815 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:start(184)) - NameNode metrics system started
2015-02-12 16:05:55,817 INFO  namenode.NameNode (NameNode.java:setClientNamenodeAddress(344)) - fs.defaultFS is hdfs://127.0.0.1:0
2015-02-12 16:05:55,842 INFO  hdfs.DFSUtil (DFSUtil.java:httpServerTemplateForNNAndJN(1681)) - Starting web server as: ${dfs.web.authentication.kerberos.principal}
2015-02-12 16:05:55,843 INFO  hdfs.DFSUtil (DFSUtil.java:httpServerTemplateForNNAndJN(1692)) - Starting Web-server for hdfs at: http://localhost:0
2015-02-12 16:05:55,887 INFO  mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2015-02-12 16:05:55,894 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.namenode is not defined
2015-02-12 16:05:55,906 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 16:05:55,909 INFO  http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
2015-02-12 16:05:55,909 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 16:05:55,910 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 16:05:55,933 INFO  http.HttpServer2 (NameNodeHttpServer.java:initWebHdfs(86)) - Added filter 'org.apache.hadoop.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter)
2015-02-12 16:05:55,936 INFO  http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(602)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2015-02-12 16:05:55,960 INFO  http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 60509
2015-02-12 16:05:55,962 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 16:05:56,003 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.5.0-cdh5.3.0/bdd3695a137ba5424a46ad303961e50aad8268aa/hadoop-hdfs-2.5.0-cdh5.3.0-tests.jar!/webapps/hdfs to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_60509_hdfs____.rm5ahe/webapp
2015-02-12 16:05:56,246 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:60509
2015-02-12 16:05:56,248 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(770)) - No KeyProvider found.
2015-02-12 16:05:56,249 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(782)) - fsLock is fair:true
2015-02-12 16:05:56,249 INFO  blockmanagement.DatanodeManager (DatanodeManager.java:<init>(232)) - dfs.block.invalidate.limit=1000
2015-02-12 16:05:56,250 INFO  blockmanagement.DatanodeManager (DatanodeManager.java:<init>(238)) - dfs.namenode.datanode.registration.ip-hostname-check=true
2015-02-12 16:05:56,250 INFO  blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(71)) - dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
2015-02-12 16:05:56,251 INFO  blockmanagement.BlockManager (InvalidateBlocks.java:printBlockDeletionTime(76)) - The block deletion will start around 2015 Feb 12 16:05:56
2015-02-12 16:05:56,251 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlocksMap
2015-02-12 16:05:56,251 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 16:05:56,252 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 2.0% max memory 672 MB = 13.4 MB
2015-02-12 16:05:56,252 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^21 = 2097152 entries
2015-02-12 16:05:56,253 INFO  blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(356)) - dfs.block.access.token.enable=false
2015-02-12 16:05:56,254 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(341)) - defaultReplication         = 3
2015-02-12 16:05:56,254 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(342)) - maxReplication             = 512
2015-02-12 16:05:56,255 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(343)) - minReplication             = 1
2015-02-12 16:05:56,255 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(344)) - maxReplicationStreams      = 2
2015-02-12 16:05:56,255 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(345)) - shouldCheckForEnoughRacks  = false
2015-02-12 16:05:56,255 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(346)) - replicationRecheckInterval = 3000
2015-02-12 16:05:56,256 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(347)) - encryptDataTransfer        = false
2015-02-12 16:05:56,256 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(348)) - maxNumBlocksToLog          = 1000
2015-02-12 16:05:56,257 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(803)) - fsOwner             = soberoi (auth:SIMPLE)
2015-02-12 16:05:56,257 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(804)) - supergroup          = supergroup
2015-02-12 16:05:56,257 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(805)) - isPermissionEnabled = true
2015-02-12 16:05:56,258 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(816)) - HA Enabled: false
2015-02-12 16:05:56,258 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(853)) - Append Enabled: true
2015-02-12 16:05:56,259 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map INodeMap
2015-02-12 16:05:56,259 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 16:05:56,260 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 1.0% max memory 672 MB = 6.7 MB
2015-02-12 16:05:56,260 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^20 = 1048576 entries
2015-02-12 16:05:56,261 INFO  namenode.NameNode (FSDirectory.java:<init>(232)) - Caching file names occuring more than 10 times
2015-02-12 16:05:56,261 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map cachedBlocks
2015-02-12 16:05:56,262 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 16:05:56,263 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.25% max memory 672 MB = 1.7 MB
2015-02-12 16:05:56,263 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^18 = 262144 entries
2015-02-12 16:05:56,264 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(5455)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2015-02-12 16:05:56,264 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(5456)) - dfs.namenode.safemode.min.datanodes = 0
2015-02-12 16:05:56,264 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(5457)) - dfs.namenode.safemode.extension     = 0
2015-02-12 16:05:56,264 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(942)) - Retry cache on namenode is enabled
2015-02-12 16:05:56,265 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(950)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2015-02-12 16:05:56,265 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map NameNodeRetryCache
2015-02-12 16:05:56,265 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 16:05:56,266 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.029999999329447746% max memory 672 MB = 206.4 KB
2015-02-12 16:05:56,266 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^15 = 32768 entries
2015-02-12 16:05:56,268 INFO  namenode.NNConf (NNConf.java:<init>(62)) - ACLs enabled? false
2015-02-12 16:05:56,268 INFO  namenode.NNConf (NNConf.java:<init>(66)) - XAttrs enabled? true
2015-02-12 16:05:56,269 INFO  namenode.NNConf (NNConf.java:<init>(74)) - Maximum size of an xattr: 16384
2015-02-12 16:05:56,271 INFO  common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/name1/in_use.lock acquired by nodename 25125@Edinburgh.local
2015-02-12 16:05:56,273 INFO  common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/name2/in_use.lock acquired by nodename 25125@Edinburgh.local
2015-02-12 16:05:56,277 INFO  namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(337)) - Recovering unfinalized segments in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/name1/current
2015-02-12 16:05:56,277 INFO  namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(337)) - Recovering unfinalized segments in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/name2/current
2015-02-12 16:05:56,278 INFO  namenode.FSImage (FSImage.java:loadFSImage(655)) - No edit log streams selected.
2015-02-12 16:05:56,300 INFO  namenode.FSImageFormatPBINode (FSImageFormatPBINode.java:loadINodeSection(214)) - Loading 1 INodes.
2015-02-12 16:05:56,306 INFO  namenode.FSImageFormatProtobuf (FSImageFormatProtobuf.java:load(171)) - Loaded FSImage in 0 seconds.
2015-02-12 16:05:56,306 INFO  namenode.FSImage (FSImage.java:loadFSImage(930)) - Loaded image for txid 0 from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/name1/current/fsimage_0000000000000000000
2015-02-12 16:05:56,310 INFO  namenode.FSNamesystem (FSNamesystem.java:loadFSImage(1011)) - Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false)
2015-02-12 16:05:56,311 INFO  namenode.FSEditLog (FSEditLog.java:startLogSegment(1162)) - Starting log segment at 1
2015-02-12 16:05:56,378 INFO  namenode.NameCache (NameCache.java:initialized(143)) - initialized with 0 entries 0 lookups
2015-02-12 16:05:56,379 INFO  namenode.FSNamesystem (FSNamesystem.java:loadFromDisk(742)) - Finished loading FSImage in 110 msecs
2015-02-12 16:05:56,539 INFO  namenode.NameNode (NameNodeRpcServer.java:<init>(317)) - RPC server is binding to localhost:0
2015-02-12 16:05:56,547 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:05:56,556 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60510
2015-02-12 16:05:56,582 INFO  namenode.NameNode (NameNode.java:initialize(595)) - Clients are to use localhost:60510 to access this namenode/service.
2015-02-12 16:05:56,587 INFO  namenode.FSNamesystem (FSNamesystem.java:registerMBean(6411)) - Registered FSNamesystemState MBean
2015-02-12 16:05:56,608 INFO  namenode.LeaseManager (LeaseManager.java:getNumUnderConstructionBlocks(132)) - Number of blocks under construction: 0
2015-02-12 16:05:56,609 INFO  namenode.LeaseManager (LeaseManager.java:getNumUnderConstructionBlocks(132)) - Number of blocks under construction: 0
2015-02-12 16:05:56,609 INFO  namenode.FSNamesystem (FSNamesystem.java:initializeReplQueues(1194)) - initializing replication queues
2015-02-12 16:05:56,609 INFO  hdfs.StateChange (FSNamesystem.java:leave(5529)) - STATE* Leaving safe mode after 0 secs
2015-02-12 16:05:56,610 INFO  hdfs.StateChange (FSNamesystem.java:leave(5540)) - STATE* Network topology has 0 racks and 0 datanodes
2015-02-12 16:05:56,610 INFO  hdfs.StateChange (FSNamesystem.java:leave(5543)) - STATE* UnderReplicatedBlocks has 0 blocks
2015-02-12 16:05:56,615 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2557)) - Total number of blocks            = 0
2015-02-12 16:05:56,615 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2558)) - Number of invalid blocks          = 0
2015-02-12 16:05:56,615 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2559)) - Number of under-replicated blocks = 0
2015-02-12 16:05:56,615 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2560)) - Number of  over-replicated blocks = 0
2015-02-12 16:05:56,616 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatesAsync(2562)) - Number of blocks being written    = 0
2015-02-12 16:05:56,616 INFO  hdfs.StateChange (BlockManager.java:processMisReplicatesAsync(2563)) - STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 6 msec
2015-02-12 16:05:56,653 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:05:56,654 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60510: starting
2015-02-12 16:05:56,656 INFO  namenode.NameNode (NameNode.java:startCommonServices(638)) - NameNode RPC up at: localhost/127.0.0.1:60510
2015-02-12 16:05:56,656 INFO  namenode.FSNamesystem (FSNamesystem.java:startActiveServices(1121)) - Starting services required for active state
2015-02-12 16:05:56,660 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(160)) - Starting CacheReplicationMonitor with interval 30000 milliseconds
2015-02-12 16:05:56,660 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(173)) - Rescanning because of pending operations
2015-02-12 16:05:56,661 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 16:05:56,693 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1295)) - Starting DataNode 0 with dfs.datanode.data.dir: [DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1,[DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2
2015-02-12 16:05:56,760 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - DataNode metrics system started (again)
2015-02-12 16:05:56,763 INFO  datanode.DataNode (DataNode.java:<init>(410)) - Configured hostname is 127.0.0.1
2015-02-12 16:05:56,766 INFO  datanode.DataNode (DataNode.java:startDataNode(1059)) - Starting DataNode with maxLockedMemory = 0
2015-02-12 16:05:56,774 INFO  datanode.DataNode (DataNode.java:initDataXceiver(863)) - Opened streaming server at /127.0.0.1:60511
2015-02-12 16:05:56,777 INFO  datanode.DataNode (DataXceiverServer.java:<init>(76)) - Balancing bandwith is 1048576 bytes/s
2015-02-12 16:05:56,778 INFO  datanode.DataNode (DataXceiverServer.java:<init>(77)) - Number threads for balancing is 5
2015-02-12 16:05:56,783 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.datanode is not defined
2015-02-12 16:05:56,784 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 16:05:56,786 INFO  http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-02-12 16:05:56,786 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 16:05:56,786 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 16:05:56,790 INFO  http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(602)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2015-02-12 16:05:56,790 INFO  http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 60512
2015-02-12 16:05:56,790 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 16:05:56,793 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.5.0-cdh5.3.0/bdd3695a137ba5424a46ad303961e50aad8268aa/hadoop-hdfs-2.5.0-cdh5.3.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_60512_datanode____mfo9hf/webapp
2015-02-12 16:05:56,929 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:60512
2015-02-12 16:05:56,931 INFO  datanode.DataNode (DataNode.java:startDataNode(1076)) - dnUserName = soberoi
2015-02-12 16:05:56,932 INFO  datanode.DataNode (DataNode.java:startDataNode(1077)) - supergroup = supergroup
2015-02-12 16:05:56,943 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:05:56,944 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60513
2015-02-12 16:05:56,949 INFO  datanode.DataNode (DataNode.java:initIpcServer(738)) - Opened IPC server at /127.0.0.1:60513
2015-02-12 16:05:56,957 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(152)) - Refresh request received for nameservices: null
2015-02-12 16:05:56,959 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(197)) - Starting BPOfferServices for nameservices: <default>
2015-02-12 16:05:56,972 INFO  datanode.DataNode (BPServiceActor.java:run(822)) - Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:60510 starting to offer service
2015-02-12 16:05:56,977 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:05:56,986 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60513: starting
2015-02-12 16:05:56,989 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1295)) - Starting DataNode 1 with dfs.datanode.data.dir: [DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3,[DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4
2015-02-12 16:05:57,069 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - DataNode metrics system started (again)
2015-02-12 16:05:57,069 INFO  datanode.DataNode (DataNode.java:<init>(410)) - Configured hostname is 127.0.0.1
2015-02-12 16:05:57,070 INFO  datanode.DataNode (DataNode.java:startDataNode(1059)) - Starting DataNode with maxLockedMemory = 0
2015-02-12 16:05:57,071 INFO  datanode.DataNode (DataNode.java:initDataXceiver(863)) - Opened streaming server at /127.0.0.1:60515
2015-02-12 16:05:57,071 INFO  datanode.DataNode (DataXceiverServer.java:<init>(76)) - Balancing bandwith is 1048576 bytes/s
2015-02-12 16:05:57,072 INFO  datanode.DataNode (DataXceiverServer.java:<init>(77)) - Number threads for balancing is 5
2015-02-12 16:05:57,074 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.datanode is not defined
2015-02-12 16:05:57,075 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 16:05:57,076 INFO  http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-02-12 16:05:57,076 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 16:05:57,077 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 16:05:57,079 INFO  http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(602)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2015-02-12 16:05:57,080 INFO  http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 60516
2015-02-12 16:05:57,080 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 16:05:57,084 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.5.0-cdh5.3.0/bdd3695a137ba5424a46ad303961e50aad8268aa/hadoop-hdfs-2.5.0-cdh5.3.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_60516_datanode____30xonb/webapp
2015-02-12 16:05:57,250 INFO  common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/in_use.lock acquired by nodename 25125@Edinburgh.local
2015-02-12 16:05:57,250 INFO  common.Storage (DataStorage.java:loadStorageDirectory(260)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1 is not formatted for BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,251 INFO  common.Storage (DataStorage.java:loadStorageDirectory(262)) - Formatting ...
2015-02-12 16:05:57,302 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:60516
2015-02-12 16:05:57,303 INFO  datanode.DataNode (DataNode.java:startDataNode(1076)) - dnUserName = soberoi
2015-02-12 16:05:57,303 INFO  datanode.DataNode (DataNode.java:startDataNode(1077)) - supergroup = supergroup
2015-02-12 16:05:57,304 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage directories for bpid BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,304 INFO  common.Storage (Storage.java:lock(672)) - Locking is disabled
2015-02-12 16:05:57,305 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:05:57,305 INFO  common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551 is not formatted for BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,305 INFO  common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
2015-02-12 16:05:57,306 INFO  common.Storage (BlockPoolSliceStorage.java:format(267)) - Formatting block pool BP-2102022600-10.1.1.67-1423785955551 directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current
2015-02-12 16:05:57,306 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60517
2015-02-12 16:05:57,307 INFO  common.Storage (BlockPoolSliceStorage.java:doTransition(355)) - Restored 0 block files from trash.
2015-02-12 16:05:57,309 INFO  common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/in_use.lock acquired by nodename 25125@Edinburgh.local
2015-02-12 16:05:57,310 INFO  common.Storage (DataStorage.java:loadStorageDirectory(260)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2 is not formatted for BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,310 INFO  common.Storage (DataStorage.java:loadStorageDirectory(262)) - Formatting ...
2015-02-12 16:05:57,310 INFO  datanode.DataNode (DataNode.java:initIpcServer(738)) - Opened IPC server at /127.0.0.1:60517
2015-02-12 16:05:57,317 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(152)) - Refresh request received for nameservices: null
2015-02-12 16:05:57,318 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(197)) - Starting BPOfferServices for nameservices: <default>
2015-02-12 16:05:57,320 INFO  datanode.DataNode (BPServiceActor.java:run(822)) - Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:60510 starting to offer service
2015-02-12 16:05:57,320 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:05:57,321 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60517: starting
2015-02-12 16:05:57,325 INFO  common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/in_use.lock acquired by nodename 25125@Edinburgh.local
2015-02-12 16:05:57,325 INFO  common.Storage (DataStorage.java:loadStorageDirectory(260)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3 is not formatted for BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,325 INFO  common.Storage (DataStorage.java:loadStorageDirectory(262)) - Formatting ...
2015-02-12 16:05:57,327 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1295)) - Starting DataNode 2 with dfs.datanode.data.dir: [DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5,[DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6
2015-02-12 16:05:57,376 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage directories for bpid BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,377 INFO  common.Storage (Storage.java:lock(672)) - Locking is disabled
2015-02-12 16:05:57,378 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage directories for bpid BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,378 INFO  common.Storage (Storage.java:lock(672)) - Locking is disabled
2015-02-12 16:05:57,380 INFO  common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551 is not formatted for BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,380 INFO  common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551 is not formatted for BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,381 INFO  common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
2015-02-12 16:05:57,381 INFO  common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
2015-02-12 16:05:57,382 INFO  common.Storage (BlockPoolSliceStorage.java:format(267)) - Formatting block pool BP-2102022600-10.1.1.67-1423785955551 directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current
2015-02-12 16:05:57,382 INFO  common.Storage (BlockPoolSliceStorage.java:format(267)) - Formatting block pool BP-2102022600-10.1.1.67-1423785955551 directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current
2015-02-12 16:05:57,383 INFO  common.Storage (BlockPoolSliceStorage.java:doTransition(355)) - Restored 0 block files from trash.
2015-02-12 16:05:57,383 INFO  common.Storage (BlockPoolSliceStorage.java:doTransition(355)) - Restored 0 block files from trash.
2015-02-12 16:05:57,384 INFO  common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/in_use.lock acquired by nodename 25125@Edinburgh.local
2015-02-12 16:05:57,384 INFO  common.Storage (DataStorage.java:loadStorageDirectory(260)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4 is not formatted for BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,384 INFO  common.Storage (DataStorage.java:loadStorageDirectory(262)) - Formatting ...
2015-02-12 16:05:57,385 INFO  datanode.DataNode (DataNode.java:initStorage(1321)) - Setting up storage: nsid=1086770231;bpid=BP-2102022600-10.1.1.67-1423785955551;lv=-56;nsInfo=lv=-59;cid=testClusterID;nsid=1086770231;c=0;bpid=BP-2102022600-10.1.1.67-1423785955551;dnuuid=null
2015-02-12 16:05:57,392 INFO  datanode.DataNode (DataNode.java:checkDatanodeUuid(1154)) - Generated and persisted new Datanode UUID 82d30123-0426-431b-a65c-18a9266604fb
2015-02-12 16:05:57,397 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - DataNode metrics system started (again)
2015-02-12 16:05:57,403 INFO  datanode.DataNode (DataNode.java:<init>(410)) - Configured hostname is 127.0.0.1
2015-02-12 16:05:57,404 INFO  datanode.DataNode (DataNode.java:startDataNode(1059)) - Starting DataNode with maxLockedMemory = 0
2015-02-12 16:05:57,405 INFO  datanode.DataNode (DataNode.java:initDataXceiver(863)) - Opened streaming server at /127.0.0.1:60518
2015-02-12 16:05:57,405 INFO  datanode.DataNode (DataXceiverServer.java:<init>(76)) - Balancing bandwith is 1048576 bytes/s
2015-02-12 16:05:57,406 INFO  datanode.DataNode (DataXceiverServer.java:<init>(77)) - Number threads for balancing is 5
2015-02-12 16:05:57,410 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.datanode is not defined
2015-02-12 16:05:57,411 INFO  impl.FsDatasetImpl (FsVolumeList.java:addVolume(212)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current
2015-02-12 16:05:57,411 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(297)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current, StorageType: DISK
2015-02-12 16:05:57,411 INFO  impl.FsDatasetImpl (FsVolumeList.java:addVolume(212)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current
2015-02-12 16:05:57,411 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(297)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current, StorageType: DISK
2015-02-12 16:05:57,413 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 16:05:57,415 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1604)) - Registered FSDatasetState MBean
2015-02-12 16:05:57,418 INFO  http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-02-12 16:05:57,419 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 16:05:57,419 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(329)) - Periodic Directory Tree Verification scan starting at 1423801050419 with interval 21600000
2015-02-12 16:05:57,419 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 16:05:57,421 INFO  http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(602)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2015-02-12 16:05:57,440 INFO  http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 60519
2015-02-12 16:05:57,440 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 16:05:57,453 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.5.0-cdh5.3.0/bdd3695a137ba5424a46ad303961e50aad8268aa/hadoop-hdfs-2.5.0-cdh5.3.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_60519_datanode____.bj48za/webapp
2015-02-12 16:05:57,459 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage directories for bpid BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,459 INFO  common.Storage (Storage.java:lock(672)) - Locking is disabled
2015-02-12 16:05:57,459 INFO  common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551 is not formatted for BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,459 INFO  common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
2015-02-12 16:05:57,459 INFO  common.Storage (BlockPoolSliceStorage.java:format(267)) - Formatting block pool BP-2102022600-10.1.1.67-1423785955551 directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current
2015-02-12 16:05:57,460 INFO  common.Storage (BlockPoolSliceStorage.java:doTransition(355)) - Restored 0 block files from trash.
2015-02-12 16:05:57,461 INFO  datanode.DataNode (DataNode.java:initStorage(1321)) - Setting up storage: nsid=1086770231;bpid=BP-2102022600-10.1.1.67-1423785955551;lv=-56;nsInfo=lv=-59;cid=testClusterID;nsid=1086770231;c=0;bpid=BP-2102022600-10.1.1.67-1423785955551;dnuuid=null
2015-02-12 16:05:57,462 INFO  datanode.DataNode (DataNode.java:checkDatanodeUuid(1154)) - Generated and persisted new Datanode UUID 3ba35078-bb62-4777-80dc-a38267fd3486
2015-02-12 16:05:57,463 INFO  impl.FsDatasetImpl (FsVolumeList.java:addVolume(212)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current
2015-02-12 16:05:57,463 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(297)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current, StorageType: DISK
2015-02-12 16:05:57,463 INFO  impl.FsDatasetImpl (FsVolumeList.java:addVolume(212)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current
2015-02-12 16:05:57,463 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(297)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current, StorageType: DISK
2015-02-12 16:05:57,464 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1604)) - Registered FSDatasetState MBean
2015-02-12 16:05:57,465 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(329)) - Periodic Directory Tree Verification scan starting at 1423785979465 with interval 21600000
2015-02-12 16:05:57,466 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1973)) - Adding block pool BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,466 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(244)) - Scanning block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current...
2015-02-12 16:05:57,467 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(244)) - Scanning block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current...
2015-02-12 16:05:57,479 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(249)) - Time taken to scan block pool BP-2102022600-10.1.1.67-1423785955551 on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current: 12ms
2015-02-12 16:05:57,420 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1973)) - Adding block pool BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,479 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(249)) - Time taken to scan block pool BP-2102022600-10.1.1.67-1423785955551 on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current: 12ms
2015-02-12 16:05:57,500 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(273)) - Total time to scan all replicas for block pool BP-2102022600-10.1.1.67-1423785955551: 34ms
2015-02-12 16:05:57,501 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(244)) - Scanning block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current...
2015-02-12 16:05:57,501 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(114)) - Adding replicas to map for block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current...
2015-02-12 16:05:57,501 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(119)) - Time to add replicas to map for block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current: 0ms
2015-02-12 16:05:57,502 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(244)) - Scanning block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current...
2015-02-12 16:05:57,502 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(114)) - Adding replicas to map for block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current...
2015-02-12 16:05:57,503 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(119)) - Time to add replicas to map for block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current: 0ms
2015-02-12 16:05:57,503 INFO  impl.FsDatasetImpl (FsVolumeList.java:getAllVolumesMap(142)) - Total time to add all replicas to map: 3ms
2015-02-12 16:05:57,506 INFO  datanode.DataNode (BPServiceActor.java:register(782)) - Block pool BP-2102022600-10.1.1.67-1423785955551 (Datanode Uuid null) service to localhost/127.0.0.1:60510 beginning handshake with NN
2015-02-12 16:05:57,508 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(249)) - Time taken to scan block pool BP-2102022600-10.1.1.67-1423785955551 on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current: 7ms
2015-02-12 16:05:57,509 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(249)) - Time taken to scan block pool BP-2102022600-10.1.1.67-1423785955551 on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current: 7ms
2015-02-12 16:05:57,510 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(273)) - Total time to scan all replicas for block pool BP-2102022600-10.1.1.67-1423785955551: 10ms
2015-02-12 16:05:57,517 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(114)) - Adding replicas to map for block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current...
2015-02-12 16:05:57,517 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(899)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, datanodeUuid=3ba35078-bb62-4777-80dc-a38267fd3486, infoPort=60516, ipcPort=60517, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0) storage 3ba35078-bb62-4777-80dc-a38267fd3486
2015-02-12 16:05:57,517 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(119)) - Time to add replicas to map for block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current: 0ms
2015-02-12 16:05:57,518 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(114)) - Adding replicas to map for block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current...
2015-02-12 16:05:57,518 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(119)) - Time to add replicas to map for block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current: 0ms
2015-02-12 16:05:57,518 INFO  impl.FsDatasetImpl (FsVolumeList.java:getAllVolumesMap(142)) - Total time to add all replicas to map: 7ms
2015-02-12 16:05:57,518 INFO  datanode.DataNode (BPServiceActor.java:register(782)) - Block pool BP-2102022600-10.1.1.67-1423785955551 (Datanode Uuid null) service to localhost/127.0.0.1:60510 beginning handshake with NN
2015-02-12 16:05:57,521 INFO  net.NetworkTopology (NetworkTopology.java:add(419)) - Adding a new node: /default-rack/127.0.0.1:60515
2015-02-12 16:05:57,523 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(899)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, datanodeUuid=82d30123-0426-431b-a65c-18a9266604fb, infoPort=60512, ipcPort=60513, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0) storage 82d30123-0426-431b-a65c-18a9266604fb
2015-02-12 16:05:57,523 INFO  net.NetworkTopology (NetworkTopology.java:add(419)) - Adding a new node: /default-rack/127.0.0.1:60511
2015-02-12 16:05:57,525 INFO  datanode.DataNode (BPServiceActor.java:register(795)) - Block pool Block pool BP-2102022600-10.1.1.67-1423785955551 (Datanode Uuid null) service to localhost/127.0.0.1:60510 successfully registered with NN
2015-02-12 16:05:57,526 INFO  datanode.DataNode (BPServiceActor.java:offerService(654)) - For namenode localhost/127.0.0.1:60510 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000
2015-02-12 16:05:57,525 INFO  datanode.DataNode (BPServiceActor.java:register(795)) - Block pool Block pool BP-2102022600-10.1.1.67-1423785955551 (Datanode Uuid null) service to localhost/127.0.0.1:60510 successfully registered with NN
2015-02-12 16:05:57,528 INFO  datanode.DataNode (BPServiceActor.java:offerService(654)) - For namenode localhost/127.0.0.1:60510 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000
2015-02-12 16:05:57,566 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(676)) - Adding new storage ID DS-26db9770-c66e-4f1e-9665-2320edc75e9f for DN 127.0.0.1:60515
2015-02-12 16:05:57,567 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(676)) - Adding new storage ID DS-aef69666-7400-49ed-afe1-288ce86bb4ec for DN 127.0.0.1:60515
2015-02-12 16:05:57,567 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(676)) - Adding new storage ID DS-f7297be7-9980-4b60-83f2-b0bd169e434b for DN 127.0.0.1:60511
2015-02-12 16:05:57,567 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(676)) - Adding new storage ID DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b for DN 127.0.0.1:60511
2015-02-12 16:05:57,577 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(509)) - Namenode Block pool BP-2102022600-10.1.1.67-1423785955551 (Datanode Uuid 82d30123-0426-431b-a65c-18a9266604fb) service to localhost/127.0.0.1:60510 trying to claim ACTIVE state with txid=1
2015-02-12 16:05:57,577 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(521)) - Acknowledging ACTIVE Namenode Block pool BP-2102022600-10.1.1.67-1423785955551 (Datanode Uuid 82d30123-0426-431b-a65c-18a9266604fb) service to localhost/127.0.0.1:60510
2015-02-12 16:05:57,578 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(509)) - Namenode Block pool BP-2102022600-10.1.1.67-1423785955551 (Datanode Uuid 3ba35078-bb62-4777-80dc-a38267fd3486) service to localhost/127.0.0.1:60510 trying to claim ACTIVE state with txid=1
2015-02-12 16:05:57,578 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(521)) - Acknowledging ACTIVE Namenode Block pool BP-2102022600-10.1.1.67-1423785955551 (Datanode Uuid 3ba35078-bb62-4777-80dc-a38267fd3486) service to localhost/127.0.0.1:60510
2015-02-12 16:05:57,586 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1770)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-26db9770-c66e-4f1e-9665-2320edc75e9f,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 16:05:57,586 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1770)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 16:05:57,586 INFO  BlockStateChange (BlockManager.java:processReport(1786)) - BLOCK* processReport: from storage DS-26db9770-c66e-4f1e-9665-2320edc75e9f node DatanodeRegistration(127.0.0.1, datanodeUuid=3ba35078-bb62-4777-80dc-a38267fd3486, infoPort=60516, ipcPort=60517, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
2015-02-12 16:05:57,587 INFO  BlockStateChange (BlockManager.java:processReport(1786)) - BLOCK* processReport: from storage DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b node DatanodeRegistration(127.0.0.1, datanodeUuid=82d30123-0426-431b-a65c-18a9266604fb, infoPort=60512, ipcPort=60513, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
2015-02-12 16:05:57,587 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1770)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-aef69666-7400-49ed-afe1-288ce86bb4ec,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 16:05:57,587 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1770)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-f7297be7-9980-4b60-83f2-b0bd169e434b,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 16:05:57,587 INFO  BlockStateChange (BlockManager.java:processReport(1786)) - BLOCK* processReport: from storage DS-aef69666-7400-49ed-afe1-288ce86bb4ec node DatanodeRegistration(127.0.0.1, datanodeUuid=3ba35078-bb62-4777-80dc-a38267fd3486, infoPort=60516, ipcPort=60517, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
2015-02-12 16:05:57,587 INFO  BlockStateChange (BlockManager.java:processReport(1786)) - BLOCK* processReport: from storage DS-f7297be7-9980-4b60-83f2-b0bd169e434b node DatanodeRegistration(127.0.0.1, datanodeUuid=82d30123-0426-431b-a65c-18a9266604fb, infoPort=60512, ipcPort=60513, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
2015-02-12 16:05:57,605 INFO  datanode.DataNode (BPServiceActor.java:blockReport(515)) - Sent 1 blockreports 0 blocks total. Took 2 msec to generate and 26 msecs for RPC and NN processing.  Got back commands org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@79092647
2015-02-12 16:05:57,605 INFO  datanode.DataNode (BPOfferService.java:processCommandFromActive(695)) - Got finalize command for block pool BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,607 INFO  datanode.DataNode (BPServiceActor.java:blockReport(515)) - Sent 1 blockreports 0 blocks total. Took 1 msec to generate and 28 msecs for RPC and NN processing.  Got back commands org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@12326d2e
2015-02-12 16:05:57,607 INFO  datanode.DataNode (BPOfferService.java:processCommandFromActive(695)) - Got finalize command for block pool BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,608 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlockMap
2015-02-12 16:05:57,608 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 16:05:57,609 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.5% max memory 672 MB = 3.4 MB
2015-02-12 16:05:57,609 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^19 = 524288 entries
2015-02-12 16:05:57,609 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(190)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,610 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlockMap
2015-02-12 16:05:57,610 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 16:05:57,611 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.5% max memory 672 MB = 3.4 MB
2015-02-12 16:05:57,611 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^19 = 524288 entries
2015-02-12 16:05:57,611 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(190)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,613 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(264)) - Added bpid=BP-2102022600-10.1.1.67-1423785955551 to blockPoolScannerMap, new size=1
2015-02-12 16:05:57,613 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(264)) - Added bpid=BP-2102022600-10.1.1.67-1423785955551 to blockPoolScannerMap, new size=1
2015-02-12 16:05:57,705 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:60519
2015-02-12 16:05:57,706 INFO  datanode.DataNode (DataNode.java:startDataNode(1076)) - dnUserName = soberoi
2015-02-12 16:05:57,707 INFO  datanode.DataNode (DataNode.java:startDataNode(1077)) - supergroup = supergroup
2015-02-12 16:05:57,709 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:05:57,710 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60520
2015-02-12 16:05:57,714 INFO  datanode.DataNode (DataNode.java:initIpcServer(738)) - Opened IPC server at /127.0.0.1:60520
2015-02-12 16:05:57,720 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(152)) - Refresh request received for nameservices: null
2015-02-12 16:05:57,721 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(197)) - Starting BPOfferServices for nameservices: <default>
2015-02-12 16:05:57,735 INFO  datanode.DataNode (BPServiceActor.java:run(822)) - Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:60510 starting to offer service
2015-02-12 16:05:57,736 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:05:57,738 INFO  common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/in_use.lock acquired by nodename 25125@Edinburgh.local
2015-02-12 16:05:57,738 INFO  common.Storage (DataStorage.java:loadStorageDirectory(260)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5 is not formatted for BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,738 INFO  common.Storage (DataStorage.java:loadStorageDirectory(262)) - Formatting ...
2015-02-12 16:05:57,744 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60520: starting
2015-02-12 16:05:57,763 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1295)) - Starting DataNode 3 with dfs.datanode.data.dir: [DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7,[DISK]file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8
2015-02-12 16:05:57,791 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage directories for bpid BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,791 INFO  common.Storage (Storage.java:lock(672)) - Locking is disabled
2015-02-12 16:05:57,791 INFO  common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551 is not formatted for BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,792 INFO  common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
2015-02-12 16:05:57,792 INFO  common.Storage (BlockPoolSliceStorage.java:format(267)) - Formatting block pool BP-2102022600-10.1.1.67-1423785955551 directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current
2015-02-12 16:05:57,792 INFO  common.Storage (BlockPoolSliceStorage.java:doTransition(355)) - Restored 0 block files from trash.
2015-02-12 16:05:57,795 INFO  common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/in_use.lock acquired by nodename 25125@Edinburgh.local
2015-02-12 16:05:57,795 INFO  common.Storage (DataStorage.java:loadStorageDirectory(260)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6 is not formatted for BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,796 INFO  common.Storage (DataStorage.java:loadStorageDirectory(262)) - Formatting ...
2015-02-12 16:05:57,830 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - DataNode metrics system started (again)
2015-02-12 16:05:57,830 INFO  datanode.DataNode (DataNode.java:<init>(410)) - Configured hostname is 127.0.0.1
2015-02-12 16:05:57,830 INFO  datanode.DataNode (DataNode.java:startDataNode(1059)) - Starting DataNode with maxLockedMemory = 0
2015-02-12 16:05:57,832 INFO  datanode.DataNode (DataNode.java:initDataXceiver(863)) - Opened streaming server at /127.0.0.1:60521
2015-02-12 16:05:57,833 INFO  datanode.DataNode (DataXceiverServer.java:<init>(76)) - Balancing bandwith is 1048576 bytes/s
2015-02-12 16:05:57,833 INFO  datanode.DataNode (DataXceiverServer.java:<init>(77)) - Number threads for balancing is 5
2015-02-12 16:05:57,835 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.datanode is not defined
2015-02-12 16:05:57,838 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 16:05:57,839 INFO  http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-02-12 16:05:57,839 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 16:05:57,839 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 16:05:57,841 INFO  http.HttpServer2 (HttpServer2.java:addJerseyResourcePackage(602)) - addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2015-02-12 16:05:57,841 INFO  http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 60522
2015-02-12 16:05:57,841 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 16:05:57,849 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.5.0-cdh5.3.0/bdd3695a137ba5424a46ad303961e50aad8268aa/hadoop-hdfs-2.5.0-cdh5.3.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_60522_datanode____e2odya/webapp
2015-02-12 16:05:57,851 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage directories for bpid BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,851 INFO  common.Storage (Storage.java:lock(672)) - Locking is disabled
2015-02-12 16:05:57,852 INFO  common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551 is not formatted for BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,852 INFO  common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
2015-02-12 16:05:57,852 INFO  common.Storage (BlockPoolSliceStorage.java:format(267)) - Formatting block pool BP-2102022600-10.1.1.67-1423785955551 directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current
2015-02-12 16:05:57,853 INFO  common.Storage (BlockPoolSliceStorage.java:doTransition(355)) - Restored 0 block files from trash.
2015-02-12 16:05:57,854 INFO  datanode.DataNode (DataNode.java:initStorage(1321)) - Setting up storage: nsid=1086770231;bpid=BP-2102022600-10.1.1.67-1423785955551;lv=-56;nsInfo=lv=-59;cid=testClusterID;nsid=1086770231;c=0;bpid=BP-2102022600-10.1.1.67-1423785955551;dnuuid=null
2015-02-12 16:05:57,856 INFO  datanode.DataNode (DataNode.java:checkDatanodeUuid(1154)) - Generated and persisted new Datanode UUID 1309dd03-96de-4536-9ff7-96af7fbd7a36
2015-02-12 16:05:57,857 INFO  impl.FsDatasetImpl (FsVolumeList.java:addVolume(212)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current
2015-02-12 16:05:57,857 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(297)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current, StorageType: DISK
2015-02-12 16:05:57,858 INFO  impl.FsDatasetImpl (FsVolumeList.java:addVolume(212)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current
2015-02-12 16:05:57,858 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(297)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current, StorageType: DISK
2015-02-12 16:05:57,858 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1604)) - Registered FSDatasetState MBean
2015-02-12 16:05:57,859 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(329)) - Periodic Directory Tree Verification scan starting at 1423789504859 with interval 21600000
2015-02-12 16:05:57,860 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1973)) - Adding block pool BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,860 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(244)) - Scanning block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current...
2015-02-12 16:05:57,861 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(244)) - Scanning block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current...
2015-02-12 16:05:57,871 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(249)) - Time taken to scan block pool BP-2102022600-10.1.1.67-1423785955551 on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current: 10ms
2015-02-12 16:05:57,871 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(249)) - Time taken to scan block pool BP-2102022600-10.1.1.67-1423785955551 on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current: 10ms
2015-02-12 16:05:57,872 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(273)) - Total time to scan all replicas for block pool BP-2102022600-10.1.1.67-1423785955551: 12ms
2015-02-12 16:05:57,873 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(114)) - Adding replicas to map for block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current...
2015-02-12 16:05:57,873 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(114)) - Adding replicas to map for block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current...
2015-02-12 16:05:57,874 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(119)) - Time to add replicas to map for block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current: 1ms
2015-02-12 16:05:57,874 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(119)) - Time to add replicas to map for block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current: 0ms
2015-02-12 16:05:57,874 INFO  impl.FsDatasetImpl (FsVolumeList.java:getAllVolumesMap(142)) - Total time to add all replicas to map: 2ms
2015-02-12 16:05:57,875 INFO  datanode.DataNode (BPServiceActor.java:register(782)) - Block pool BP-2102022600-10.1.1.67-1423785955551 (Datanode Uuid null) service to localhost/127.0.0.1:60510 beginning handshake with NN
2015-02-12 16:05:57,877 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(899)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, datanodeUuid=1309dd03-96de-4536-9ff7-96af7fbd7a36, infoPort=60519, ipcPort=60520, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0) storage 1309dd03-96de-4536-9ff7-96af7fbd7a36
2015-02-12 16:05:57,877 INFO  net.NetworkTopology (NetworkTopology.java:add(419)) - Adding a new node: /default-rack/127.0.0.1:60518
2015-02-12 16:05:57,879 INFO  datanode.DataNode (BPServiceActor.java:register(795)) - Block pool Block pool BP-2102022600-10.1.1.67-1423785955551 (Datanode Uuid null) service to localhost/127.0.0.1:60510 successfully registered with NN
2015-02-12 16:05:57,879 INFO  datanode.DataNode (BPServiceActor.java:offerService(654)) - For namenode localhost/127.0.0.1:60510 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000
2015-02-12 16:05:57,880 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(676)) - Adding new storage ID DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83 for DN 127.0.0.1:60518
2015-02-12 16:05:57,880 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(676)) - Adding new storage ID DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862 for DN 127.0.0.1:60518
2015-02-12 16:05:57,881 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(509)) - Namenode Block pool BP-2102022600-10.1.1.67-1423785955551 (Datanode Uuid 1309dd03-96de-4536-9ff7-96af7fbd7a36) service to localhost/127.0.0.1:60510 trying to claim ACTIVE state with txid=1
2015-02-12 16:05:57,881 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(521)) - Acknowledging ACTIVE Namenode Block pool BP-2102022600-10.1.1.67-1423785955551 (Datanode Uuid 1309dd03-96de-4536-9ff7-96af7fbd7a36) service to localhost/127.0.0.1:60510
2015-02-12 16:05:57,884 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1770)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 16:05:57,884 INFO  BlockStateChange (BlockManager.java:processReport(1786)) - BLOCK* processReport: from storage DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83 node DatanodeRegistration(127.0.0.1, datanodeUuid=1309dd03-96de-4536-9ff7-96af7fbd7a36, infoPort=60519, ipcPort=60520, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
2015-02-12 16:05:57,884 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1770)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 16:05:57,885 INFO  BlockStateChange (BlockManager.java:processReport(1786)) - BLOCK* processReport: from storage DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862 node DatanodeRegistration(127.0.0.1, datanodeUuid=1309dd03-96de-4536-9ff7-96af7fbd7a36, infoPort=60519, ipcPort=60520, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0), blocks: 0, hasStaleStorages: false, processing time: 1 msecs
2015-02-12 16:05:57,885 INFO  datanode.DataNode (BPServiceActor.java:blockReport(515)) - Sent 1 blockreports 0 blocks total. Took 0 msec to generate and 3 msecs for RPC and NN processing.  Got back commands org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@22340d4e
2015-02-12 16:05:57,885 INFO  datanode.DataNode (BPOfferService.java:processCommandFromActive(695)) - Got finalize command for block pool BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,886 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlockMap
2015-02-12 16:05:57,886 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 16:05:57,886 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.5% max memory 672 MB = 3.4 MB
2015-02-12 16:05:57,886 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^19 = 524288 entries
2015-02-12 16:05:57,886 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(190)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:57,887 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(264)) - Added bpid=BP-2102022600-10.1.1.67-1423785955551 to blockPoolScannerMap, new size=1
2015-02-12 16:05:58,033 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:60522
2015-02-12 16:05:58,035 INFO  datanode.DataNode (DataNode.java:startDataNode(1076)) - dnUserName = soberoi
2015-02-12 16:05:58,035 INFO  datanode.DataNode (DataNode.java:startDataNode(1077)) - supergroup = supergroup
2015-02-12 16:05:58,036 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:05:58,037 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60523
2015-02-12 16:05:58,039 INFO  datanode.DataNode (DataNode.java:initIpcServer(738)) - Opened IPC server at /127.0.0.1:60523
2015-02-12 16:05:58,044 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(152)) - Refresh request received for nameservices: null
2015-02-12 16:05:58,045 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(197)) - Starting BPOfferServices for nameservices: <default>
2015-02-12 16:05:58,046 INFO  datanode.DataNode (BPServiceActor.java:run(822)) - Block pool <registering> (Datanode Uuid unassigned) service to localhost/127.0.0.1:60510 starting to offer service
2015-02-12 16:05:58,047 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:05:58,047 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60523: starting
2015-02-12 16:05:58,053 INFO  common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/in_use.lock acquired by nodename 25125@Edinburgh.local
2015-02-12 16:05:58,053 INFO  common.Storage (DataStorage.java:loadStorageDirectory(260)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7 is not formatted for BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:58,053 INFO  common.Storage (DataStorage.java:loadStorageDirectory(262)) - Formatting ...
2015-02-12 16:05:58,099 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage directories for bpid BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:58,099 INFO  common.Storage (Storage.java:lock(672)) - Locking is disabled
2015-02-12 16:05:58,099 INFO  common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551 is not formatted for BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:58,100 INFO  common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
2015-02-12 16:05:58,100 INFO  common.Storage (BlockPoolSliceStorage.java:format(267)) - Formatting block pool BP-2102022600-10.1.1.67-1423785955551 directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current
2015-02-12 16:05:58,101 INFO  common.Storage (BlockPoolSliceStorage.java:doTransition(355)) - Restored 0 block files from trash.
2015-02-12 16:05:58,102 INFO  common.Storage (Storage.java:tryLock(712)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/in_use.lock acquired by nodename 25125@Edinburgh.local
2015-02-12 16:05:58,102 INFO  common.Storage (DataStorage.java:loadStorageDirectory(260)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8 is not formatted for BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:58,102 INFO  common.Storage (DataStorage.java:loadStorageDirectory(262)) - Formatting ...
2015-02-12 16:05:58,151 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage directories for bpid BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:58,151 INFO  common.Storage (Storage.java:lock(672)) - Locking is disabled
2015-02-12 16:05:58,152 INFO  common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551 is not formatted for BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:58,152 INFO  common.Storage (BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
2015-02-12 16:05:58,152 INFO  common.Storage (BlockPoolSliceStorage.java:format(267)) - Formatting block pool BP-2102022600-10.1.1.67-1423785955551 directory /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current
2015-02-12 16:05:58,153 INFO  common.Storage (BlockPoolSliceStorage.java:doTransition(355)) - Restored 0 block files from trash.
2015-02-12 16:05:58,153 INFO  datanode.DataNode (DataNode.java:initStorage(1321)) - Setting up storage: nsid=1086770231;bpid=BP-2102022600-10.1.1.67-1423785955551;lv=-56;nsInfo=lv=-59;cid=testClusterID;nsid=1086770231;c=0;bpid=BP-2102022600-10.1.1.67-1423785955551;dnuuid=null
2015-02-12 16:05:58,154 INFO  datanode.DataNode (DataNode.java:checkDatanodeUuid(1154)) - Generated and persisted new Datanode UUID ea98f7fc-75be-4946-bca6-e0b6950404d2
2015-02-12 16:05:58,155 INFO  impl.FsDatasetImpl (FsVolumeList.java:addVolume(212)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current
2015-02-12 16:05:58,155 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(297)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current, StorageType: DISK
2015-02-12 16:05:58,156 INFO  impl.FsDatasetImpl (FsVolumeList.java:addVolume(212)) - Added new volume: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current
2015-02-12 16:05:58,156 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addVolume(297)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current, StorageType: DISK
2015-02-12 16:05:58,156 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1604)) - Registered FSDatasetState MBean
2015-02-12 16:05:58,157 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(329)) - Periodic Directory Tree Verification scan starting at 1423806882157 with interval 21600000
2015-02-12 16:05:58,158 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1973)) - Adding block pool BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:58,158 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(244)) - Scanning block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current...
2015-02-12 16:05:58,158 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(244)) - Scanning block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current...
2015-02-12 16:05:58,167 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(249)) - Time taken to scan block pool BP-2102022600-10.1.1.67-1423785955551 on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current: 9ms
2015-02-12 16:05:58,167 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(249)) - Time taken to scan block pool BP-2102022600-10.1.1.67-1423785955551 on /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current: 8ms
2015-02-12 16:05:58,167 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(273)) - Total time to scan all replicas for block pool BP-2102022600-10.1.1.67-1423785955551: 9ms
2015-02-12 16:05:58,168 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(114)) - Adding replicas to map for block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current...
2015-02-12 16:05:58,168 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(114)) - Adding replicas to map for block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current...
2015-02-12 16:05:58,168 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(119)) - Time to add replicas to map for block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current: 0ms
2015-02-12 16:05:58,168 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(119)) - Time to add replicas to map for block pool BP-2102022600-10.1.1.67-1423785955551 on volume /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current: 0ms
2015-02-12 16:05:58,169 INFO  impl.FsDatasetImpl (FsVolumeList.java:getAllVolumesMap(142)) - Total time to add all replicas to map: 1ms
2015-02-12 16:05:58,169 INFO  datanode.DataNode (BPServiceActor.java:register(782)) - Block pool BP-2102022600-10.1.1.67-1423785955551 (Datanode Uuid null) service to localhost/127.0.0.1:60510 beginning handshake with NN
2015-02-12 16:05:58,171 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(899)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, datanodeUuid=ea98f7fc-75be-4946-bca6-e0b6950404d2, infoPort=60522, ipcPort=60523, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0) storage ea98f7fc-75be-4946-bca6-e0b6950404d2
2015-02-12 16:05:58,172 INFO  net.NetworkTopology (NetworkTopology.java:add(419)) - Adding a new node: /default-rack/127.0.0.1:60521
2015-02-12 16:05:58,174 INFO  datanode.DataNode (BPServiceActor.java:register(795)) - Block pool Block pool BP-2102022600-10.1.1.67-1423785955551 (Datanode Uuid null) service to localhost/127.0.0.1:60510 successfully registered with NN
2015-02-12 16:05:58,175 INFO  datanode.DataNode (BPServiceActor.java:offerService(654)) - For namenode localhost/127.0.0.1:60510 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000
2015-02-12 16:05:58,177 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(676)) - Adding new storage ID DS-b4d70e9e-0385-4907-87b1-da33b47a75ae for DN 127.0.0.1:60521
2015-02-12 16:05:58,177 INFO  blockmanagement.DatanodeDescriptor (DatanodeDescriptor.java:updateStorage(676)) - Adding new storage ID DS-5f2bc4c2-e139-4aaf-be70-e525472a223d for DN 127.0.0.1:60521
2015-02-12 16:05:58,179 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(509)) - Namenode Block pool BP-2102022600-10.1.1.67-1423785955551 (Datanode Uuid ea98f7fc-75be-4946-bca6-e0b6950404d2) service to localhost/127.0.0.1:60510 trying to claim ACTIVE state with txid=1
2015-02-12 16:05:58,179 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(521)) - Acknowledging ACTIVE Namenode Block pool BP-2102022600-10.1.1.67-1423785955551 (Datanode Uuid ea98f7fc-75be-4946-bca6-e0b6950404d2) service to localhost/127.0.0.1:60510
2015-02-12 16:05:58,182 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1770)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-b4d70e9e-0385-4907-87b1-da33b47a75ae,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 16:05:58,182 INFO  BlockStateChange (BlockManager.java:processReport(1786)) - BLOCK* processReport: from storage DS-b4d70e9e-0385-4907-87b1-da33b47a75ae node DatanodeRegistration(127.0.0.1, datanodeUuid=ea98f7fc-75be-4946-bca6-e0b6950404d2, infoPort=60522, ipcPort=60523, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
2015-02-12 16:05:58,182 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1770)) - BLOCK* processReport: Received first block report from DatanodeStorage[DS-5f2bc4c2-e139-4aaf-be70-e525472a223d,DISK,NORMAL] after starting up or becoming active. Its block contents are no longer considered stale
2015-02-12 16:05:58,183 INFO  BlockStateChange (BlockManager.java:processReport(1786)) - BLOCK* processReport: from storage DS-5f2bc4c2-e139-4aaf-be70-e525472a223d node DatanodeRegistration(127.0.0.1, datanodeUuid=ea98f7fc-75be-4946-bca6-e0b6950404d2, infoPort=60522, ipcPort=60523, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
2015-02-12 16:05:58,185 INFO  datanode.DataNode (BPServiceActor.java:blockReport(515)) - Sent 1 blockreports 0 blocks total. Took 1 msec to generate and 4 msecs for RPC and NN processing.  Got back commands org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@4750be19
2015-02-12 16:05:58,185 INFO  datanode.DataNode (BPOfferService.java:processCommandFromActive(695)) - Got finalize command for block pool BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:58,185 INFO  util.GSet (LightWeightGSet.java:computeCapacity(354)) - Computing capacity for map BlockMap
2015-02-12 16:05:58,185 INFO  util.GSet (LightWeightGSet.java:computeCapacity(355)) - VM type       = 64-bit
2015-02-12 16:05:58,185 INFO  util.GSet (LightWeightGSet.java:computeCapacity(356)) - 0.5% max memory 672 MB = 3.4 MB
2015-02-12 16:05:58,185 INFO  util.GSet (LightWeightGSet.java:computeCapacity(361)) - capacity      = 2^19 = 524288 entries
2015-02-12 16:05:58,187 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(190)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-2102022600-10.1.1.67-1423785955551
2015-02-12 16:05:58,188 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(264)) - Added bpid=BP-2102022600-10.1.1.67-1423785955551 to blockPoolScannerMap, new size=1
2015-02-12 16:05:58,565 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:waitActive(2113)) - Cluster is active
2015-02-12 16:05:58,590 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:05:58,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:05:58,643 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar. BP-2102022600-10.1.1.67-1423785955551 blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]}
2015-02-12 16:05:58,684 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741825_1001 src: /127.0.0.1:60525 dest: /127.0.0.1:60518
2015-02-12 16:05:58,697 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741825_1001 src: /127.0.0.1:60526 dest: /127.0.0.1:60511
2015-02-12 16:05:58,700 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741825_1001 src: /127.0.0.1:60527 dest: /127.0.0.1:60521
2015-02-12 16:05:58,742 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60527, dest: /127.0.0.1:60521, bytes: 498874, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741825_1001, duration: 25118000
2015-02-12 16:05:58,743 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741825_1001, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:05:58,746 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60526, dest: /127.0.0.1:60511, bytes: 498874, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741825_1001, duration: 30968000
2015-02-12 16:05:58,746 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741825_1001, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:05:58,748 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60525, dest: /127.0.0.1:60518, bytes: 498874, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741825_1001, duration: 33993000
2015-02-12 16:05:58,749 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741825_1001, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:05:58,757 INFO  namenode.FSNamesystem (FSNamesystem.java:checkFileProgress(3532)) - BLOCK* checkFileProgress: blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]} has not reached minimal replication 1
2015-02-12 16:05:58,757 INFO  namenode.EditLogFileOutputStream (EditLogFileOutputStream.java:flushAndSync(200)) - Nothing to flush
2015-02-12 16:05:58,757 INFO  namenode.EditLogFileOutputStream (EditLogFileOutputStream.java:flushAndSync(200)) - Nothing to flush
2015-02-12 16:05:58,759 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]} size 498874
2015-02-12 16:05:58,760 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741825_1001 size 498874
2015-02-12 16:05:58,760 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741825_1001 size 498874
2015-02-12 16:05:59,164 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:05:59,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=soberoi:supergroup:rwxr--r--	proto=rpc
2015-02-12 16:05:59,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:05:59,278 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:05:59,280 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar. BP-2102022600-10.1.1.67-1423785955551 blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:05:59,283 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741826_1002 src: /127.0.0.1:60528 dest: /127.0.0.1:60521
2015-02-12 16:05:59,285 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741826_1002 src: /127.0.0.1:60529 dest: /127.0.0.1:60515
2015-02-12 16:05:59,286 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741826_1002 src: /127.0.0.1:60530 dest: /127.0.0.1:60511
2015-02-12 16:05:59,294 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60530, dest: /127.0.0.1:60511, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741826_1002, duration: 6103000
2015-02-12 16:05:59,294 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741826_1002, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:05:59,295 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 0
2015-02-12 16:05:59,295 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60529, dest: /127.0.0.1:60515, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741826_1002, duration: 7433000
2015-02-12 16:05:59,296 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741826_1002, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:05:59,297 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 0
2015-02-12 16:05:59,298 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60528, dest: /127.0.0.1:60521, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741826_1002, duration: 9382000
2015-02-12 16:05:59,298 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741826_1002, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:05:59,299 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:05:59,300 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:05:59,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=soberoi:supergroup:rwxr--r--	proto=rpc
2015-02-12 16:05:59,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging	dst=null	perm=null	proto=rpc
2015-02-12 16:05:59,372 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceInit(154)) - mkdir: hdfs://localhost:60510/tmp/hadoop-yarn/staging
2015-02-12 16:05:59,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 16:05:59,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 16:05:59,438 INFO  conf.Configuration (Configuration.java:getConfResourceAsInputStream(2204)) - core-site.xml not found
2015-02-12 16:05:59,438 INFO  security.Groups (Groups.java:refresh(202)) - clearing userToGroupsMap cache
2015-02-12 16:05:59,441 INFO  conf.Configuration (Configuration.java:getConfResourceAsInputStream(2204)) - yarn-site.xml not found
2015-02-12 16:05:59,447 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher
2015-02-12 16:05:59,468 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:<init>(75)) - NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms
2015-02-12 16:05:59,470 INFO  security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:<init>(76)) - ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms
2015-02-12 16:05:59,473 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:<init>(94)) - AMRMTokenKeyRollingInterval: 86400000ms and AMRMTokenKeyActivationDelay: 900000 ms
2015-02-12 16:05:59,483 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler
2015-02-12 16:05:59,487 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager
2015-02-12 16:05:59,487 INFO  resourcemanager.ResourceManager (ResourceManager.java:createScheduler(268)) - Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler
2015-02-12 16:05:59,521 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher
2015-02-12 16:05:59,522 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher
2015-02-12 16:05:59,524 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher
2015-02-12 16:05:59,526 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher
2015-02-12 16:05:59,541 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - ResourceManager metrics system started (again)
2015-02-12 16:05:59,553 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager
2015-02-12 16:05:59,561 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher
2015-02-12 16:05:59,563 INFO  resourcemanager.RMNMInfo (RMNMInfo.java:<init>(63)) - Registered RMNMInfo MBean
2015-02-12 16:05:59,565 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 16:05:59,565 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 16:05:59,566 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 16:05:59,566 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 16:05:59,566 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 16:05:59,566 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 16:05:59,567 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 16:05:59,568 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 16:05:59,568 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 16:05:59,568 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.ahs.WritingHistoryEventType for class org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter$ForwardingEventHandler
2015-02-12 16:05:59,569 INFO  util.HostsFileReader (HostsFileReader.java:refresh(129)) - Refreshing hosts (include/exclude) list
2015-02-12 16:05:59,594 WARN  fair.AllocationFileLoaderService (AllocationFileLoaderService.java:getAllocationFile(179)) - fair-scheduler.xml not found on the classpath.
2015-02-12 16:05:59,598 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$1
2015-02-12 16:05:59,599 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0
2015-02-12 16:05:59,599 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1
2015-02-12 16:05:59,600 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2
2015-02-12 16:05:59,600 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3
2015-02-12 16:05:59,600 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_0
2015-02-12 16:05:59,600 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_1
2015-02-12 16:05:59,601 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_2
2015-02-12 16:05:59,601 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_3
2015-02-12 16:05:59,601 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceInit(528)) - Starting NM: 0
2015-02-12 16:05:59,657 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-02-12 16:05:59,660 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-02-12 16:05:59,661 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-02-12 16:05:59,662 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-02-12 16:05:59,664 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-02-12 16:05:59,664 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-02-12 16:05:59,669 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-02-12 16:05:59,670 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$ShortCircuitedNodeManager
2015-02-12 16:05:59,671 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - NodeManager metrics system started (again)
2015-02-12 16:05:59,683 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-02-12 16:05:59,683 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(216)) - per directory file limit = 8192
2015-02-12 16:05:59,890 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-02-12 16:05:59,904 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-02-12 16:05:59,905 INFO  containermanager.AuxServices (AuxServices.java:addService(72)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-02-12 16:05:59,928 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(101)) -  Using ResourceCalculatorPlugin : null
2015-02-12 16:05:59,929 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(106)) -  Using ResourceCalculatorProcessTree : null
2015-02-12 16:05:59,929 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(136)) - Physical memory check enabled: false
2015-02-12 16:05:59,930 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(137)) - Virtual memory check enabled: false
2015-02-12 16:05:59,932 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(176)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-02-12 16:05:59,932 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0
2015-02-12 16:05:59,933 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1
2015-02-12 16:05:59,933 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2
2015-02-12 16:05:59,933 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3
2015-02-12 16:05:59,934 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_0
2015-02-12 16:05:59,934 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_1
2015-02-12 16:05:59,934 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_2
2015-02-12 16:05:59,934 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_3
2015-02-12 16:05:59,934 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceInit(528)) - Starting NM: 1
2015-02-12 16:05:59,953 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-02-12 16:05:59,954 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-02-12 16:05:59,954 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-02-12 16:05:59,955 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-02-12 16:05:59,955 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-02-12 16:05:59,955 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-02-12 16:05:59,956 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-02-12 16:05:59,956 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$ShortCircuitedNodeManager
2015-02-12 16:05:59,956 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - NodeManager metrics system started (again)
2015-02-12 16:05:59,965 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-02-12 16:05:59,966 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(216)) - per directory file limit = 8192
2015-02-12 16:06:00,178 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-02-12 16:06:00,179 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-02-12 16:06:00,180 INFO  containermanager.AuxServices (AuxServices.java:addService(72)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-02-12 16:06:00,182 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(101)) -  Using ResourceCalculatorPlugin : null
2015-02-12 16:06:00,182 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(106)) -  Using ResourceCalculatorProcessTree : null
2015-02-12 16:06:00,182 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(136)) - Physical memory check enabled: false
2015-02-12 16:06:00,183 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(137)) - Virtual memory check enabled: false
2015-02-12 16:06:00,183 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(176)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-02-12 16:06:00,184 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0
2015-02-12 16:06:00,184 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1
2015-02-12 16:06:00,184 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2
2015-02-12 16:06:00,185 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3
2015-02-12 16:06:00,185 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_0
2015-02-12 16:06:00,185 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_1
2015-02-12 16:06:00,186 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_2
2015-02-12 16:06:00,186 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_3
2015-02-12 16:06:00,188 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceInit(528)) - Starting NM: 2
2015-02-12 16:06:00,201 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-02-12 16:06:00,201 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-02-12 16:06:00,202 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-02-12 16:06:00,202 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-02-12 16:06:00,202 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-02-12 16:06:00,202 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-02-12 16:06:00,202 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-02-12 16:06:00,203 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$ShortCircuitedNodeManager
2015-02-12 16:06:00,203 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - NodeManager metrics system started (again)
2015-02-12 16:06:00,206 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-02-12 16:06:00,206 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(216)) - per directory file limit = 8192
2015-02-12 16:06:00,399 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-02-12 16:06:00,400 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-02-12 16:06:00,400 INFO  containermanager.AuxServices (AuxServices.java:addService(72)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-02-12 16:06:00,403 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(101)) -  Using ResourceCalculatorPlugin : null
2015-02-12 16:06:00,403 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(106)) -  Using ResourceCalculatorProcessTree : null
2015-02-12 16:06:00,404 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(136)) - Physical memory check enabled: false
2015-02-12 16:06:00,404 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(137)) - Virtual memory check enabled: false
2015-02-12 16:06:00,404 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(176)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-02-12 16:06:00,405 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0
2015-02-12 16:06:00,405 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1
2015-02-12 16:06:00,405 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2
2015-02-12 16:06:00,405 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3
2015-02-12 16:06:00,405 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_0
2015-02-12 16:06:00,406 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_1
2015-02-12 16:06:00,406 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_2
2015-02-12 16:06:00,406 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(546)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_3
2015-02-12 16:06:00,406 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceInit(528)) - Starting NM: 3
2015-02-12 16:06:00,416 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-02-12 16:06:00,417 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-02-12 16:06:00,417 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-02-12 16:06:00,417 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-02-12 16:06:00,417 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-02-12 16:06:00,417 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-02-12 16:06:00,418 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-02-12 16:06:00,418 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$ShortCircuitedNodeManager
2015-02-12 16:06:00,418 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - NodeManager metrics system started (again)
2015-02-12 16:06:00,421 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-02-12 16:06:00,421 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(216)) - per directory file limit = 8192
2015-02-12 16:06:00,614 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-02-12 16:06:00,616 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(130)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-02-12 16:06:00,616 INFO  containermanager.AuxServices (AuxServices.java:addService(72)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-02-12 16:06:00,618 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(101)) -  Using ResourceCalculatorPlugin : null
2015-02-12 16:06:00,618 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(106)) -  Using ResourceCalculatorProcessTree : null
2015-02-12 16:06:00,619 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(136)) - Physical memory check enabled: false
2015-02-12 16:06:00,619 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(137)) - Virtual memory check enabled: false
2015-02-12 16:06:00,619 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(176)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-02-12 16:06:00,631 INFO  hs.JobHistory (JobHistory.java:serviceInit(83)) - JobHistory Init
2015-02-12 16:06:00,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=null	proto=rpc
2015-02-12 16:06:00,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 16:06:00,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 16:06:00,648 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 16:06:00,648 INFO  hs.HistoryFileManager (HistoryFileManager.java:mkdir(645)) - Perms after creating 511, Expected: 1023
2015-02-12 16:06:00,648 INFO  hs.HistoryFileManager (HistoryFileManager.java:mkdir(648)) - Explicitly setting permissions to : 1023, rwxrwxrwt
2015-02-12 16:06:00,651 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=soberoi:supergroup:rwxrwxrwt	proto=rpc
2015-02-12 16:06:07,431 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741826_1002
2015-02-12 16:06:07,436 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741825_1001
2015-02-12 16:06:07,471 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741826_1002
2015-02-12 16:06:07,871 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741825_1001
2015-02-12 16:06:08,165 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741825_1001
2015-02-12 16:06:08,169 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741826_1002
2015-02-12 16:06:10,657 INFO  hs.HistoryFileManager (HistoryFileManager.java:initExisting(664)) - Initializing Existing Jobs...
2015-02-12 16:06:10,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=null	proto=rpc
2015-02-12 16:06:10,665 INFO  hs.CachedHistoryStorage (CachedHistoryStorage.java:serviceInit(66)) - CachedHistoryStorage Init
2015-02-12 16:06:10,675 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:06:10,676 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60548
2015-02-12 16:06:10,679 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(214)) - Waiting for HistoryServer to start...
2015-02-12 16:06:10,679 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - JobHistoryServer metrics system started (again)
2015-02-12 16:06:10,680 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(329)) - Updating the current master key for generating delegation tokens
2015-02-12 16:06:10,682 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(641)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-02-12 16:06:10,682 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(329)) - Updating the current master key for generating delegation tokens
2015-02-12 16:06:10,687 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.jobhistory is not defined
2015-02-12 16:06:10,687 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 16:06:10,688 INFO  http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context jobhistory
2015-02-12 16:06:10,688 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 16:06:10,688 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 16:06:10,688 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /jobhistory/*
2015-02-12 16:06:10,689 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /ws/*
2015-02-12 16:06:10,690 INFO  http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 60549
2015-02-12 16:06:10,690 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 16:06:10,692 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.5.0-cdh5.3.0/ab28ad57af245463f66a5da314dffc684fe9cc13/hadoop-yarn-common-2.5.0-cdh5.3.0.jar!/webapps/jobhistory to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_60549_jobhistory____27h53l/webapp
2015-02-12 16:06:10,803 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@Edinburgh.local:60549
2015-02-12 16:06:10,804 INFO  webapp.WebApps (WebApps.java:start(274)) - Web app /jobhistory started at 60549
2015-02-12 16:06:11,050 INFO  webapp.WebApps (WebApps.java:start(288)) - Registered webapp guice modules
2015-02-12 16:06:11,058 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:06:11,059 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60550
2015-02-12 16:06:11,062 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.mapreduce.v2.api.HSClientProtocolPB to the server
2015-02-12 16:06:11,063 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:06:11,063 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60550: starting
2015-02-12 16:06:11,066 INFO  hs.HistoryClientService (HistoryClientService.java:serviceStart(146)) - Instantiated HistoryClientService at 10.1.1.67/10.1.1.67:60550
2015-02-12 16:06:11,067 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:06:11,067 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60548: starting
2015-02-12 16:06:11,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/fail	dst=null	perm=null	proto=rpc
2015-02-12 16:06:12,180 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(231)) - MiniMRYARN ResourceManager address: Edinburgh.local:0
2015-02-12 16:06:12,180 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(233)) - MiniMRYARN ResourceManager web address: Edinburgh.local:0
2015-02-12 16:06:12,181 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(235)) - MiniMRYARN HistoryServer address: 10.1.1.67:60550
2015-02-12 16:06:12,181 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(237)) - MiniMRYARN HistoryServer web address: Edinburgh.local:60549
2015-02-12 16:06:12,182 INFO  server.MiniYARNCluster (MiniYARNCluster.java:startResourceManager(318)) - Waiting for RM to start...
2015-02-12 16:06:12,182 INFO  resourcemanager.ResourceManager (ResourceManager.java:transitionToActive(956)) - Transitioning to active state
2015-02-12 16:06:12,191 INFO  security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:rollMasterKey(104)) - Rolling master-key for container-tokens
2015-02-12 16:06:12,191 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:rollMasterKey(95)) - Rolling master-key for nm-tokens
2015-02-12 16:06:12,191 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(329)) - Updating the current master key for generating delegation tokens
2015-02-12 16:06:12,192 INFO  security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(87)) - storing master key with keyID 1
2015-02-12 16:06:12,192 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(641)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-02-12 16:06:12,193 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(329)) - Updating the current master key for generating delegation tokens
2015-02-12 16:06:12,193 INFO  security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(87)) - storing master key with keyID 2
2015-02-12 16:06:12,205 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:06:12,206 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60551
2015-02-12 16:06:12,210 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server
2015-02-12 16:06:12,210 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:06:12,211 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60551: starting
2015-02-12 16:06:12,234 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:06:12,235 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60552
2015-02-12 16:06:12,239 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB to the server
2015-02-12 16:06:12,240 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:06:12,240 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60552: starting
2015-02-12 16:06:12,280 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:06:12,280 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60553
2015-02-12 16:06:12,283 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB to the server
2015-02-12 16:06:12,284 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:06:12,284 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60553: starting
2015-02-12 16:06:12,297 INFO  resourcemanager.ResourceManager (ResourceManager.java:transitionToActive(976)) - Transitioned to active state
2015-02-12 16:06:12,301 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.resourcemanager is not defined
2015-02-12 16:06:12,302 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 16:06:12,305 INFO  http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context cluster
2015-02-12 16:06:12,305 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context static
2015-02-12 16:06:12,306 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context logs
2015-02-12 16:06:12,306 INFO  http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context cluster
2015-02-12 16:06:12,306 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 16:06:12,306 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 16:06:12,307 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /cluster/*
2015-02-12 16:06:12,307 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /ws/*
2015-02-12 16:06:12,308 INFO  http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 60554
2015-02-12 16:06:12,308 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 16:06:12,310 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.5.0-cdh5.3.0/ab28ad57af245463f66a5da314dffc684fe9cc13/hadoop-yarn-common-2.5.0-cdh5.3.0.jar!/webapps/cluster to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_60554_cluster____.1cqcv2/webapp
2015-02-12 16:06:13,111 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@Edinburgh.local:60554
2015-02-12 16:06:13,111 INFO  webapp.WebApps (WebApps.java:start(274)) - Web app /cluster started at 60554
2015-02-12 16:06:13,149 INFO  webapp.WebApps (WebApps.java:start(288)) - Registered webapp guice modules
2015-02-12 16:06:13,169 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:06:13,170 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60555
2015-02-12 16:06:13,173 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to the server
2015-02-12 16:06:13,173 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:06:13,173 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60555: starting
2015-02-12 16:06:13,682 INFO  server.MiniYARNCluster (MiniYARNCluster.java:startResourceManager(330)) - MiniYARN ResourceManager address: 10.1.1.67:60553
2015-02-12 16:06:13,683 INFO  server.MiniYARNCluster (MiniYARNCluster.java:startResourceManager(332)) - MiniYARN ResourceManager web address: Edinburgh.local:60554
2015-02-12 16:06:13,683 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(449)) - MiniYARN ResourceManager address: 10.1.1.67:60553
2015-02-12 16:06:13,684 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(451)) - MiniYARN ResourceManager web address: Edinburgh.local:60554
2015-02-12 16:06:13,685 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(563)) - Waiting for NM 0 to start...
2015-02-12 16:06:13,693 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:06:13,694 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60556
2015-02-12 16:06:13,697 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-02-12 16:06:13,697 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(411)) - Blocking new container-requests as container manager rpc server is still starting.
2015-02-12 16:06:13,697 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:06:13,698 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60556: starting
2015-02-12 16:06:13,704 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(260)) - Updating node address : 10.1.1.67:60556
2015-02-12 16:06:13,711 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:06:13,712 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60557
2015-02-12 16:06:13,714 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-02-12 16:06:13,715 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:06:13,715 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60557: starting
2015-02-12 16:06:13,719 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(341)) - Localizer started on port 60557
2015-02-12 16:06:13,731 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-02-12 16:06:13,748 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(393)) - httpshuffle listening on port 60558
2015-02-12 16:06:13,748 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:13,750 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(456)) - ContainerManager started at /10.1.1.67:60556
2015-02-12 16:06:13,750 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(457)) - ContainerManager bound to Edinburgh.local/10.1.1.67:0
2015-02-12 16:06:13,750 INFO  webapp.WebServer (WebServer.java:serviceStart(62)) - Instantiating NMWebApp at Edinburgh.local:0
2015-02-12 16:06:13,751 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.nodemanager is not defined
2015-02-12 16:06:13,751 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 16:06:13,752 INFO  http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-02-12 16:06:13,752 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 16:06:13,752 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 16:06:13,753 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /node/*
2015-02-12 16:06:13,753 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /ws/*
2015-02-12 16:06:13,753 INFO  http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 60559
2015-02-12 16:06:13,754 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 16:06:13,757 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.5.0-cdh5.3.0/ab28ad57af245463f66a5da314dffc684fe9cc13/hadoop-yarn-common-2.5.0-cdh5.3.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_60559_node____.c4fmpn/webapp
2015-02-12 16:06:14,196 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@Edinburgh.local:60559
2015-02-12 16:06:14,196 INFO  webapp.WebApps (WebApps.java:start(274)) - Web app /node started at 60559
2015-02-12 16:06:14,216 INFO  webapp.WebApps (WebApps.java:start(288)) - Registered webapp guice modules
2015-02-12 16:06:14,219 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(417)) - Sending out 0 NM container statuses: []
2015-02-12 16:06:14,224 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(256)) - Registering with RM using containers :[]
2015-02-12 16:06:14,235 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.67 to /default-rack
2015-02-12 16:06:14,238 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(341)) - NodeManager from node 10.1.1.67(cmPort: 60556 httpPort: 60559) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.67:60556
2015-02-12 16:06:14,238 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id -179156762
2015-02-12 16:06:14,242 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(135)) - Rolling master-key for container-tokens, got key with id 1408397154
2015-02-12 16:06:14,242 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(423)) - 10.1.1.67:60556 Node Transitioned from NEW to RUNNING
2015-02-12 16:06:14,242 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(305)) - Registered with ResourceManager as 10.1.1.67:60556 with total resource of <memory:4096, vCores:8>
2015-02-12 16:06:14,243 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(307)) - Notifying ContainerManager to unblock new container-requests
2015-02-12 16:06:14,248 INFO  fair.FairScheduler (FairScheduler.java:addNode(838)) - Added node 10.1.1.67:60556 cluster capacity: <memory:4096, vCores:8>
2015-02-12 16:06:14,691 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(563)) - Waiting for NM 1 to start...
2015-02-12 16:06:14,695 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:06:14,696 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60560
2015-02-12 16:06:14,698 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-02-12 16:06:14,698 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(411)) - Blocking new container-requests as container manager rpc server is still starting.
2015-02-12 16:06:14,699 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:06:14,699 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60560: starting
2015-02-12 16:06:14,703 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(260)) - Updating node address : 10.1.1.67:60560
2015-02-12 16:06:14,704 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:06:14,705 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60561
2015-02-12 16:06:14,707 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-02-12 16:06:14,708 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:06:14,708 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60561: starting
2015-02-12 16:06:14,710 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(341)) - Localizer started on port 60561
2015-02-12 16:06:14,711 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-02-12 16:06:14,712 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(393)) - httpshuffle listening on port 60562
2015-02-12 16:06:14,712 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:14,713 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(456)) - ContainerManager started at /10.1.1.67:60560
2015-02-12 16:06:14,713 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(457)) - ContainerManager bound to Edinburgh.local/10.1.1.67:0
2015-02-12 16:06:14,713 INFO  webapp.WebServer (WebServer.java:serviceStart(62)) - Instantiating NMWebApp at Edinburgh.local:0
2015-02-12 16:06:14,714 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.nodemanager is not defined
2015-02-12 16:06:14,714 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 16:06:14,715 INFO  http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-02-12 16:06:14,715 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 16:06:14,715 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 16:06:14,715 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /node/*
2015-02-12 16:06:14,716 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /ws/*
2015-02-12 16:06:14,716 INFO  http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 60563
2015-02-12 16:06:14,716 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 16:06:14,720 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.5.0-cdh5.3.0/ab28ad57af245463f66a5da314dffc684fe9cc13/hadoop-yarn-common-2.5.0-cdh5.3.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_60563_node____lx0fa6/webapp
2015-02-12 16:06:14,990 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@Edinburgh.local:60563
2015-02-12 16:06:14,991 INFO  webapp.WebApps (WebApps.java:start(274)) - Web app /node started at 60563
2015-02-12 16:06:14,997 INFO  webapp.WebApps (WebApps.java:start(288)) - Registered webapp guice modules
2015-02-12 16:06:14,998 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(417)) - Sending out 0 NM container statuses: []
2015-02-12 16:06:14,998 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(256)) - Registering with RM using containers :[]
2015-02-12 16:06:14,999 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.67 to /default-rack
2015-02-12 16:06:14,999 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(423)) - 10.1.1.67:60560 Node Transitioned from NEW to RUNNING
2015-02-12 16:06:14,999 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(341)) - NodeManager from node 10.1.1.67(cmPort: 60560 httpPort: 60563) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.67:60560
2015-02-12 16:06:15,000 INFO  fair.FairScheduler (FairScheduler.java:addNode(838)) - Added node 10.1.1.67:60560 cluster capacity: <memory:8192, vCores:16>
2015-02-12 16:06:15,000 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id -179156762
2015-02-12 16:06:15,001 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(135)) - Rolling master-key for container-tokens, got key with id 1408397154
2015-02-12 16:06:15,001 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(305)) - Registered with ResourceManager as 10.1.1.67:60560 with total resource of <memory:4096, vCores:8>
2015-02-12 16:06:15,001 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(307)) - Notifying ContainerManager to unblock new container-requests
2015-02-12 16:06:15,696 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(563)) - Waiting for NM 2 to start...
2015-02-12 16:06:15,699 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:06:15,700 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60564
2015-02-12 16:06:15,703 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-02-12 16:06:15,703 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(411)) - Blocking new container-requests as container manager rpc server is still starting.
2015-02-12 16:06:15,703 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:06:15,703 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60564: starting
2015-02-12 16:06:15,709 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(260)) - Updating node address : 10.1.1.67:60564
2015-02-12 16:06:15,710 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:06:15,710 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60565
2015-02-12 16:06:15,712 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-02-12 16:06:15,713 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:06:15,713 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60565: starting
2015-02-12 16:06:15,715 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(341)) - Localizer started on port 60565
2015-02-12 16:06:15,716 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-02-12 16:06:15,717 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(393)) - httpshuffle listening on port 60566
2015-02-12 16:06:15,717 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:15,718 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(456)) - ContainerManager started at /10.1.1.67:60564
2015-02-12 16:06:15,718 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(457)) - ContainerManager bound to Edinburgh.local/10.1.1.67:0
2015-02-12 16:06:15,718 INFO  webapp.WebServer (WebServer.java:serviceStart(62)) - Instantiating NMWebApp at Edinburgh.local:0
2015-02-12 16:06:15,718 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.nodemanager is not defined
2015-02-12 16:06:15,719 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 16:06:15,719 INFO  http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-02-12 16:06:15,720 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 16:06:15,720 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 16:06:15,720 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /node/*
2015-02-12 16:06:15,720 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /ws/*
2015-02-12 16:06:15,721 INFO  http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 60567
2015-02-12 16:06:15,721 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 16:06:15,723 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.5.0-cdh5.3.0/ab28ad57af245463f66a5da314dffc684fe9cc13/hadoop-yarn-common-2.5.0-cdh5.3.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_60567_node____.qmblwe/webapp
2015-02-12 16:06:15,941 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@Edinburgh.local:60567
2015-02-12 16:06:15,942 INFO  webapp.WebApps (WebApps.java:start(274)) - Web app /node started at 60567
2015-02-12 16:06:15,947 INFO  webapp.WebApps (WebApps.java:start(288)) - Registered webapp guice modules
2015-02-12 16:06:15,948 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(417)) - Sending out 0 NM container statuses: []
2015-02-12 16:06:15,948 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(256)) - Registering with RM using containers :[]
2015-02-12 16:06:15,949 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.67 to /default-rack
2015-02-12 16:06:15,949 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(341)) - NodeManager from node 10.1.1.67(cmPort: 60564 httpPort: 60567) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.67:60564
2015-02-12 16:06:15,949 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(423)) - 10.1.1.67:60564 Node Transitioned from NEW to RUNNING
2015-02-12 16:06:15,949 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id -179156762
2015-02-12 16:06:15,949 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(135)) - Rolling master-key for container-tokens, got key with id 1408397154
2015-02-12 16:06:15,949 INFO  fair.FairScheduler (FairScheduler.java:addNode(838)) - Added node 10.1.1.67:60564 cluster capacity: <memory:12288, vCores:24>
2015-02-12 16:06:15,949 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(305)) - Registered with ResourceManager as 10.1.1.67:60564 with total resource of <memory:4096, vCores:8>
2015-02-12 16:06:15,949 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(307)) - Notifying ContainerManager to unblock new container-requests
2015-02-12 16:06:16,699 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(563)) - Waiting for NM 3 to start...
2015-02-12 16:06:16,703 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:06:16,704 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60568
2015-02-12 16:06:16,707 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-02-12 16:06:16,707 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(411)) - Blocking new container-requests as container manager rpc server is still starting.
2015-02-12 16:06:16,708 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:06:16,709 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60568: starting
2015-02-12 16:06:16,714 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(260)) - Updating node address : 10.1.1.67:60568
2015-02-12 16:06:16,715 INFO  ipc.CallQueueManager (CallQueueManager.java:<init>(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-02-12 16:06:16,715 INFO  ipc.Server (Server.java:run(593)) - Starting Socket Reader #1 for port 60569
2015-02-12 16:06:16,717 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-02-12 16:06:16,718 INFO  ipc.Server (Server.java:run(815)) - IPC Server Responder: starting
2015-02-12 16:06:16,718 INFO  ipc.Server (Server.java:run(662)) - IPC Server listener on 60569: starting
2015-02-12 16:06:16,721 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(341)) - Localizer started on port 60569
2015-02-12 16:06:16,722 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-02-12 16:06:16,723 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(393)) - httpshuffle listening on port 60570
2015-02-12 16:06:16,723 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:16,724 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(456)) - ContainerManager started at /10.1.1.67:60568
2015-02-12 16:06:16,724 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(457)) - ContainerManager bound to Edinburgh.local/10.1.1.67:0
2015-02-12 16:06:16,724 INFO  webapp.WebServer (WebServer.java:serviceStart(62)) - Instantiating NMWebApp at Edinburgh.local:0
2015-02-12 16:06:16,724 INFO  http.HttpRequestLog (HttpRequestLog.java:getRequestLog(80)) - Http request log for http.requests.nodemanager is not defined
2015-02-12 16:06:16,725 INFO  http.HttpServer2 (HttpServer2.java:addGlobalFilter(698)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-02-12 16:06:16,725 INFO  http.HttpServer2 (HttpServer2.java:addFilter(676)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-02-12 16:06:16,725 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-02-12 16:06:16,725 INFO  http.HttpServer2 (HttpServer2.java:addFilter(683)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-02-12 16:06:16,726 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /node/*
2015-02-12 16:06:16,726 INFO  http.HttpServer2 (HttpServer2.java:initializeWebServer(401)) - adding path spec: /ws/*
2015-02-12 16:06:16,727 INFO  http.HttpServer2 (HttpServer2.java:openListeners(886)) - Jetty bound to port 60571
2015-02-12 16:06:16,727 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26.cloudera.4
2015-02-12 16:06:16,729 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.5.0-cdh5.3.0/ab28ad57af245463f66a5da314dffc684fe9cc13/hadoop-yarn-common-2.5.0-cdh5.3.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_60571_node____7f4g3f/webapp
2015-02-12 16:06:16,945 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started HttpServer2$SelectChannelConnectorWithSafeStartup@Edinburgh.local:60571
2015-02-12 16:06:16,946 INFO  webapp.WebApps (WebApps.java:start(274)) - Web app /node started at 60571
2015-02-12 16:06:16,951 INFO  webapp.WebApps (WebApps.java:start(288)) - Registered webapp guice modules
2015-02-12 16:06:16,952 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(417)) - Sending out 0 NM container statuses: []
2015-02-12 16:06:16,952 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(256)) - Registering with RM using containers :[]
2015-02-12 16:06:16,953 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.67 to /default-rack
2015-02-12 16:06:16,953 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(341)) - NodeManager from node 10.1.1.67(cmPort: 60568 httpPort: 60571) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.67:60568
2015-02-12 16:06:16,953 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(423)) - 10.1.1.67:60568 Node Transitioned from NEW to RUNNING
2015-02-12 16:06:16,953 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id -179156762
2015-02-12 16:06:16,953 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(135)) - Rolling master-key for container-tokens, got key with id 1408397154
2015-02-12 16:06:16,953 INFO  fair.FairScheduler (FairScheduler.java:addNode(838)) - Added node 10.1.1.67:60568 cluster capacity: <memory:16384, vCores:32>
2015-02-12 16:06:16,953 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(305)) - Registered with ResourceManager as 10.1.1.67:60568 with total resource of <memory:4096, vCores:8>
2015-02-12 16:06:16,954 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(307)) - Notifying ContainerManager to unblock new container-requests
2015-02-12 16:06:17,729 INFO  property.AppProps (AppProps.java:getAppID(169)) - using app.id: A91FE5B487F841A4B0268D7314B8EAE3
2015-02-12 16:06:17,751 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 16:06:17,752 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 16:06:17,798 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1022)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-02-12 16:06:17,807 INFO  hadoop.Hfs (Hfs.java:makeLocal(507)) - forcing job to local mode, via source: Lfs["TextLine[['offset', 'line']->[ALL]]"]["input/path"]
2015-02-12 16:06:17,807 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1022)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-02-12 16:06:17,817 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1022)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-02-12 16:06:17,895 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 16:06:17,895 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 16:06:17,901 INFO  hadoop.Hfs (Hfs.java:makeLocal(507)) - forcing job to local mode, via source: Lfs["TextLine[['offset', 'line']->[ALL]]"]["input/path"]
2015-02-12 16:06:17,922 INFO  hadoop.Hfs (Hfs.java:makeLocal(507)) - forcing job to local mode, via source: Lfs["TextLine[['offset', 'line']->[ALL]]"]["input/path"]
2015-02-12 16:06:17,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:06:17,930 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:06:17,934 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:06:17,937 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt. BP-2102022600-10.1.1.67-1423785955551 blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]}
2015-02-12 16:06:17,941 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741827_1003 src: /127.0.0.1:60572 dest: /127.0.0.1:60521
2015-02-12 16:06:17,942 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741827_1003 src: /127.0.0.1:60573 dest: /127.0.0.1:60518
2015-02-12 16:06:17,945 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741827_1003 src: /127.0.0.1:60574 dest: /127.0.0.1:60511
2015-02-12 16:06:17,957 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60574, dest: /127.0.0.1:60511, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741827_1003, duration: 10192000
2015-02-12 16:06:17,958 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741827_1003, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:06:17,958 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]} size 0
2015-02-12 16:06:17,961 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60573, dest: /127.0.0.1:60518, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741827_1003, duration: 12552000
2015-02-12 16:06:17,962 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741827_1003, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:17,965 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:17,965 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60572, dest: /127.0.0.1:60521, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741827_1003, duration: 17886000
2015-02-12 16:06:17,966 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741827_1003, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:17,971 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:17,974 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:06:17,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:06:17,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:06:17,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:06:17,981 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt. BP-2102022600-10.1.1.67-1423785955551 blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:06:17,983 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741828_1004 src: /127.0.0.1:60575 dest: /127.0.0.1:60518
2015-02-12 16:06:17,985 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741828_1004 src: /127.0.0.1:60576 dest: /127.0.0.1:60515
2015-02-12 16:06:17,991 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741828_1004 src: /127.0.0.1:60577 dest: /127.0.0.1:60511
2015-02-12 16:06:17,999 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60577, dest: /127.0.0.1:60511, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741828_1004, duration: 4412000
2015-02-12 16:06:18,000 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741828_1004, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:06:18,000 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 0
2015-02-12 16:06:18,003 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60576, dest: /127.0.0.1:60515, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741828_1004, duration: 8133000
2015-02-12 16:06:18,004 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741828_1004, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,005 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 0
2015-02-12 16:06:18,006 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60575, dest: /127.0.0.1:60518, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741828_1004, duration: 11802000
2015-02-12 16:06:18,006 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741828_1004, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,007 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:18,010 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:06:18,038 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 16:06:18,041 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 16:06:18,119 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(391)) - calling start
2015-02-12 16:06:18,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,137 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.6.3
2015-02-12 16:06:18,138 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 16:06:18,139 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-02-12 16:06:18,139 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 16:06:18,139 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped"]
2015-02-12 16:06:18,140 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  parallel execution is enabled: true
2015-02-12 16:06:18,140 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  starting jobs: 3
2015-02-12 16:06:18,140 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  allocating threads: 3
2015-02-12 16:06:18,141 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (2/3)
2015-02-12 16:06:18,141 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/3)
2015-02-12 16:06:18,170 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:60553
2015-02-12 16:06:18,255 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:60553
2015-02-12 16:06:18,268 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:60553
2015-02-12 16:06:18,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,282 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,285 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:60553
2015-02-12 16:06:18,286 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 16:06:18,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,293 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,311 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 1
2015-02-12 16:06:18,311 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 2
2015-02-12 16:06:18,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,326 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 16:06:18,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 16:06:18,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 16:06:18,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 16:06:18,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:06:18,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:06:18,339 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar. BP-2102022600-10.1.1.67-1423785955551 blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]}
2015-02-12 16:06:18,340 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar. BP-2102022600-10.1.1.67-1423785955551 blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]}
2015-02-12 16:06:18,341 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741829_1005 src: /127.0.0.1:60579 dest: /127.0.0.1:60518
2015-02-12 16:06:18,342 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741830_1006 src: /127.0.0.1:60580 dest: /127.0.0.1:60518
2015-02-12 16:06:18,344 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741830_1006 src: /127.0.0.1:60582 dest: /127.0.0.1:60521
2015-02-12 16:06:18,344 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741829_1005 src: /127.0.0.1:60581 dest: /127.0.0.1:60511
2015-02-12 16:06:18,347 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741830_1006 src: /127.0.0.1:60584 dest: /127.0.0.1:60515
2015-02-12 16:06:18,347 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741829_1005 src: /127.0.0.1:60583 dest: /127.0.0.1:60515
2015-02-12 16:06:18,365 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60583, dest: /127.0.0.1:60515, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741829_1005, duration: 14287000
2015-02-12 16:06:18,365 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741829_1005, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:06:18,368 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]} size 0
2015-02-12 16:06:18,368 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60584, dest: /127.0.0.1:60515, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741830_1006, duration: 18749000
2015-02-12 16:06:18,368 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741830_1006, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:06:18,369 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60581, dest: /127.0.0.1:60511, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741829_1005, duration: 17774000
2015-02-12 16:06:18,369 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,372 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:18,372 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60582, dest: /127.0.0.1:60521, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741830_1006, duration: 21815000
2015-02-12 16:06:18,373 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,372 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60579, dest: /127.0.0.1:60518, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741829_1005, duration: 21694000
2015-02-12 16:06:18,374 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,373 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]} size 0
2015-02-12 16:06:18,376 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60580, dest: /127.0.0.1:60518, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741830_1006, duration: 24646000
2015-02-12 16:06:18,377 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:18,377 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,377 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:18,379 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:18,379 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:06:18,380 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:06:18,385 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar
2015-02-12 16:06:18,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,386 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar
2015-02-12 16:06:18,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:06:18,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:06:18,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,402 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,402 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,405 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,405 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,409 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,409 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,412 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,413 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,431 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 16:06:18,431 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 16:06:18,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:06:18,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:06:18,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:06:18,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:06:18,460 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.split
2015-02-12 16:06:18,461 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.split
2015-02-12 16:06:18,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,462 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,465 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.split. BP-2102022600-10.1.1.67-1423785955551 blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]}
2015-02-12 16:06:18,466 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.split. BP-2102022600-10.1.1.67-1423785955551 blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:06:18,469 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741831_1007 src: /127.0.0.1:60585 dest: /127.0.0.1:60521
2015-02-12 16:06:18,470 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741832_1008 src: /127.0.0.1:60586 dest: /127.0.0.1:60515
2015-02-12 16:06:18,472 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741831_1007 src: /127.0.0.1:60587 dest: /127.0.0.1:60515
2015-02-12 16:06:18,472 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741832_1008 src: /127.0.0.1:60588 dest: /127.0.0.1:60521
2015-02-12 16:06:18,474 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741831_1007 src: /127.0.0.1:60590 dest: /127.0.0.1:60518
2015-02-12 16:06:18,474 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741832_1008 src: /127.0.0.1:60589 dest: /127.0.0.1:60518
2015-02-12 16:06:18,477 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741832_1008 src: /127.0.0.1:60592 dest: /127.0.0.1:60511
2015-02-12 16:06:18,477 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741831_1007 src: /127.0.0.1:60591 dest: /127.0.0.1:60511
2015-02-12 16:06:18,497 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60592, dest: /127.0.0.1:60511, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741832_1008, duration: 13301000
2015-02-12 16:06:18,497 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60591, dest: /127.0.0.1:60511, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741831_1007, duration: 17359000
2015-02-12 16:06:18,497 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741832_1008, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:06:18,497 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741831_1007, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:06:18,500 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60589, dest: /127.0.0.1:60518, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741832_1008, duration: 18679000
2015-02-12 16:06:18,501 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741832_1008, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,501 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60590, dest: /127.0.0.1:60518, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741831_1007, duration: 20650000
2015-02-12 16:06:18,502 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741831_1007, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,504 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60588, dest: /127.0.0.1:60521, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741832_1008, duration: 23993000
2015-02-12 16:06:18,505 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741832_1008, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,505 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 0
2015-02-12 16:06:18,505 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60587, dest: /127.0.0.1:60515, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741831_1007, duration: 25103000
2015-02-12 16:06:18,505 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741831_1007, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,507 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60586, dest: /127.0.0.1:60515, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741832_1008, duration: 25666000
2015-02-12 16:06:18,509 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741832_1008, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,509 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60585, dest: /127.0.0.1:60521, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741831_1007, duration: 27983000
2015-02-12 16:06:18,509 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741831_1007, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,511 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 0
2015-02-12 16:06:18,513 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:18,513 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:18,515 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.split is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:06:18,516 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741831_1007 size 1787
2015-02-12 16:06:18,516 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.split is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:06:18,517 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741832_1008 size 1787
2015-02-12 16:06:18,517 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741832_1008 size 1787
2015-02-12 16:06:18,520 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:06:18,520 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741831_1007 size 1787
2015-02-12 16:06:18,520 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:06:18,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:06:18,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:06:18,527 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.splitmetainfo. BP-2102022600-10.1.1.67-1423785955551 blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]}
2015-02-12 16:06:18,527 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.splitmetainfo. BP-2102022600-10.1.1.67-1423785955551 blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]}
2015-02-12 16:06:18,530 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741833_1009 src: /127.0.0.1:60593 dest: /127.0.0.1:60511
2015-02-12 16:06:18,531 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741834_1010 src: /127.0.0.1:60594 dest: /127.0.0.1:60511
2015-02-12 16:06:18,534 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741834_1010 src: /127.0.0.1:60596 dest: /127.0.0.1:60515
2015-02-12 16:06:18,534 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741833_1009 src: /127.0.0.1:60595 dest: /127.0.0.1:60515
2015-02-12 16:06:18,536 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741834_1010 src: /127.0.0.1:60597 dest: /127.0.0.1:60518
2015-02-12 16:06:18,536 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741833_1009 src: /127.0.0.1:60598 dest: /127.0.0.1:60518
2015-02-12 16:06:18,543 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60597, dest: /127.0.0.1:60518, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741834_1010, duration: 4862000
2015-02-12 16:06:18,543 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60598, dest: /127.0.0.1:60518, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741833_1009, duration: 4107000
2015-02-12 16:06:18,543 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741833_1009, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:06:18,543 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741834_1010, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:06:18,544 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60596, dest: /127.0.0.1:60515, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741834_1010, duration: 5319000
2015-02-12 16:06:18,544 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]} size 0
2015-02-12 16:06:18,545 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60595, dest: /127.0.0.1:60515, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741833_1009, duration: 5358000
2015-02-12 16:06:18,545 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741833_1009, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,545 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741834_1010, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,546 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60594, dest: /127.0.0.1:60511, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741834_1010, duration: 7571000
2015-02-12 16:06:18,546 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741834_1010, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,547 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60593, dest: /127.0.0.1:60511, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741833_1009, duration: 7186000
2015-02-12 16:06:18,547 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741833_1009, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,549 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:18,550 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:18,552 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:18,553 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:06:18,554 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741834_1010 size 183
2015-02-12 16:06:18,554 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:06:18,554 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 16:06:18,554 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741833_1009 size 183
2015-02-12 16:06:18,555 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 16:06:18,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:06:18,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:06:18,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:06:18,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:06:18,750 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml. BP-2102022600-10.1.1.67-1423785955551 blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]}
2015-02-12 16:06:18,753 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741835_1011 src: /127.0.0.1:60599 dest: /127.0.0.1:60518
2015-02-12 16:06:18,756 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741835_1011 src: /127.0.0.1:60600 dest: /127.0.0.1:60511
2015-02-12 16:06:18,757 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml. BP-2102022600-10.1.1.67-1423785955551 blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]}
2015-02-12 16:06:18,761 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741835_1011 src: /127.0.0.1:60601 dest: /127.0.0.1:60521
2015-02-12 16:06:18,763 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741836_1012 src: /127.0.0.1:60602 dest: /127.0.0.1:60518
2015-02-12 16:06:18,767 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741836_1012 src: /127.0.0.1:60603 dest: /127.0.0.1:60511
2015-02-12 16:06:18,768 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60601, dest: /127.0.0.1:60521, bytes: 96394, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741835_1011, duration: 4287000
2015-02-12 16:06:18,768 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741835_1011, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:06:18,769 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60600, dest: /127.0.0.1:60511, bytes: 96394, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741835_1011, duration: 5498000
2015-02-12 16:06:18,769 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741836_1012 src: /127.0.0.1:60604 dest: /127.0.0.1:60515
2015-02-12 16:06:18,769 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741835_1011, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,770 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60599, dest: /127.0.0.1:60518, bytes: 96394, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741835_1011, duration: 5998000
2015-02-12 16:06:18,770 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741835_1011, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,773 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:18,774 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:18,777 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741835_1011 size 96394
2015-02-12 16:06:18,778 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:06:18,778 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60604, dest: /127.0.0.1:60515, bytes: 96402, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741836_1012, duration: 6843000
2015-02-12 16:06:18,778 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741836_1012, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:06:18,778 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423785972183_0001
2015-02-12 16:06:18,779 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60603, dest: /127.0.0.1:60511, bytes: 96402, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741836_1012, duration: 7301000
2015-02-12 16:06:18,779 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741836_1012, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,780 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60602, dest: /127.0.0.1:60518, bytes: 96402, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741836_1012, duration: 8446000
2015-02-12 16:06:18,780 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741836_1012, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:18,781 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]} size 0
2015-02-12 16:06:18,782 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]} size 0
2015-02-12 16:06:18,782 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]} size 0
2015-02-12 16:06:18,783 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:06:18,784 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423785972183_0002
2015-02-12 16:06:18,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,862 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,866 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,866 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:18,933 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 2 submitted by user soberoi
2015-02-12 16:06:18,933 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 1 submitted by user soberoi
2015-02-12 16:06:18,933 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423785972183_0001
2015-02-12 16:06:18,934 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0001 State change from NEW to NEW_SAVING
2015-02-12 16:06:18,934 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi	IP=10.1.1.67	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423785972183_0001
2015-02-12 16:06:18,934 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi	IP=10.1.1.67	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423785972183_0002
2015-02-12 16:06:18,934 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423785972183_0002
2015-02-12 16:06:18,935 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0002 State change from NEW to NEW_SAVING
2015-02-12 16:06:18,942 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423785972183_0001
2015-02-12 16:06:18,943 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423785972183_0002
2015-02-12 16:06:18,961 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0001 State change from NEW_SAVING to SUBMITTED
2015-02-12 16:06:18,961 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0002 State change from NEW_SAVING to SUBMITTED
2015-02-12 16:06:18,969 INFO  fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423785972183_0001 from user: soberoi, in queue: default, currently num of applications: 1
2015-02-12 16:06:18,969 INFO  fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423785972183_0002 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 16:06:18,971 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0001 State change from SUBMITTED to ACCEPTED
2015-02-12 16:06:18,972 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0002 State change from SUBMITTED to ACCEPTED
2015-02-12 16:06:18,996 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423785972183_0001_000001
2015-02-12 16:06:18,997 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0001_000001 State change from NEW to SUBMITTED
2015-02-12 16:06:18,998 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423785972183_0002_000001
2015-02-12 16:06:18,998 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0002_000001 State change from NEW to SUBMITTED
2015-02-12 16:06:19,003 INFO  fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423785972183_0001_000001 to scheduler from user: soberoi
2015-02-12 16:06:19,004 INFO  fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423785972183_0002_000001 to scheduler from user: soberoi
2015-02-12 16:06:19,006 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0001_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 16:06:19,006 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0002_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 16:06:19,167 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423785972183_0002
2015-02-12 16:06:19,167 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423785972183_0001
2015-02-12 16:06:19,193 INFO  mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:60554/proxy/application_1423785972183_0002/
2015-02-12 16:06:19,193 INFO  mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:60554/proxy/application_1423785972183_0001/
2015-02-12 16:06:19,194 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423785972183_0002
2015-02-12 16:06:19,194 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423785972183_0001
2015-02-12 16:06:19,194 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60554/proxy/application_1423785972183_0002/
2015-02-12 16:06:19,194 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60554/proxy/application_1423785972183_0001/
2015-02-12 16:06:19,290 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:06:19,290 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000001
2015-02-12 16:06:19,290 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0001_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:60556, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 16:06:19,293 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60556 for container : container_1423785972183_0001_01_000001
2015-02-12 16:06:19,297 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:06:19,297 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423785972183_0001_000001
2015-02-12 16:06:19,298 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423785972183_0001 AttemptId: appattempt_1423785972183_0001_000001 MasterContainer: Container: [ContainerId: container_1423785972183_0001_01_000001, NodeId: 10.1.1.67:60556, NodeHttpAddress: 10.1.1.67:60559, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60556 }, ]
2015-02-12 16:06:19,299 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0001_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 16:06:19,308 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0001_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 16:06:19,315 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423785972183_0001_000001
2015-02-12 16:06:19,328 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423785972183_0001_01_000001, NodeId: 10.1.1.67:60556, NodeHttpAddress: 10.1.1.67:60559, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60556 }, ] for AM appattempt_1423785972183_0001_000001
2015-02-12 16:06:19,329 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423785972183_0001_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 16:06:19,330 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423785972183_0001_000001
2015-02-12 16:06:19,331 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423785972183_0001_000001
2015-02-12 16:06:19,359 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0001_000001 (auth:SIMPLE)
2015-02-12 16:06:19,374 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0001_01_000001 by user soberoi
2015-02-12 16:06:19,391 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0001
2015-02-12 16:06:19,397 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0001 transitioned from NEW to INITING
2015-02-12 16:06:19,398 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0001_01_000001 to application application_1423785972183_0001
2015-02-12 16:06:19,399 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000001
2015-02-12 16:06:19,406 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0001 transitioned from INITING to RUNNING
2015-02-12 16:06:19,410 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 16:06:19,410 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0001
2015-02-12 16:06:19,414 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423785972183_0001_01_000001, NodeId: 10.1.1.67:60556, NodeHttpAddress: 10.1.1.67:60559, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60556 }, ] for AM appattempt_1423785972183_0001_000001
2015-02-12 16:06:19,416 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0001_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 16:06:19,424 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:06:19,424 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:06:19,425 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:06:19,425 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 16:06:19,425 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.split transitioned from INIT to DOWNLOADING
2015-02-12 16:06:19,425 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:06:19,425 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar, 1423785959300, FILE, null }
2015-02-12 16:06:19,479 INFO  datanode.DirectoryScanner (DirectoryScanner.java:scan(484)) - BlockPool BP-2102022600-10.1.1.67-1423785955551 Total blocks: 9, missing metadata files:0, missing block files:0, missing blocks in memory:0, mismatched blocks:0
2015-02-12 16:06:19,560 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423785959163, FILE, null }
2015-02-12 16:06:19,597 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:19,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 16:06:19,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 16:06:19,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:06:19,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 16:06:19,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 16:06:19,635 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:19,747 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/filecache/10/hadoop-3483439372465658835.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:19,788 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0001_01_000001
2015-02-12 16:06:19,812 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423785972183_0001_01_000001.tokens. Credentials list: 
2015-02-12 16:06:19,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:19,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:19,903 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/filecache/11/MRAppJar.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:19,965 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:06:19,965 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000001
2015-02-12 16:06:19,965 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0002_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:60568, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 16:06:19,966 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60568 for container : container_1423785972183_0002_01_000001
2015-02-12 16:06:19,967 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:06:19,967 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423785972183_0002_000001
2015-02-12 16:06:19,967 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423785972183_0002 AttemptId: appattempt_1423785972183_0002_000001 MasterContainer: Container: [ContainerId: container_1423785972183_0002_01_000001, NodeId: 10.1.1.67:60568, NodeHttpAddress: 10.1.1.67:60571, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60568 }, ]
2015-02-12 16:06:19,967 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0002_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 16:06:19,968 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0002_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 16:06:19,968 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423785972183_0002_000001
2015-02-12 16:06:19,970 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423785972183_0002_01_000001, NodeId: 10.1.1.67:60568, NodeHttpAddress: 10.1.1.67:60571, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60568 }, ] for AM appattempt_1423785972183_0002_000001
2015-02-12 16:06:19,970 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423785972183_0002_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 16:06:19,971 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423785972183_0002_000001
2015-02-12 16:06:19,971 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423785972183_0002_000001
2015-02-12 16:06:19,975 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0002_000001 (auth:SIMPLE)
2015-02-12 16:06:19,979 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0002_01_000001 by user soberoi
2015-02-12 16:06:19,981 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0002
2015-02-12 16:06:19,981 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000001
2015-02-12 16:06:19,982 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0002 transitioned from NEW to INITING
2015-02-12 16:06:19,983 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0002_01_000001 to application application_1423785972183_0002
2015-02-12 16:06:19,984 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423785972183_0002_01_000001, NodeId: 10.1.1.67:60568, NodeHttpAddress: 10.1.1.67:60571, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60568 }, ] for AM appattempt_1423785972183_0002_000001
2015-02-12 16:06:19,984 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0002 transitioned from INITING to RUNNING
2015-02-12 16:06:19,984 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0002_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 16:06:19,985 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 16:06:19,985 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0002
2015-02-12 16:06:19,986 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:06:19,986 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:06:19,986 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:06:19,986 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 16:06:19,986 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.split transitioned from INIT to DOWNLOADING
2015-02-12 16:06:19,986 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:06:19,987 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar, 1423785959300, FILE, null }
2015-02-12 16:06:19,996 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:06:20,124 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423785959163, FILE, null }
2015-02-12 16:06:20,149 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423785972183_0001_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000001.tokens
2015-02-12 16:06:20,149 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:06:20,160 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,162 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,165 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,236 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/filecache/10/hadoop-3483439372465658835.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:20,282 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:06:20,294 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0002_01_000001
2015-02-12 16:06:20,313 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423785972183_0002_01_000001.tokens. Credentials list: 
2015-02-12 16:06:20,333 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,433 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/filecache/11/MRAppJar.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:20,483 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0001/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:20,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,523 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:06:20,574 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0001/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:20,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,612 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,655 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:60515 to replicate blk_1073741829_1005 to datanode(s) 127.0.0.1:60521
2015-02-12 16:06:20,656 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:60515 to replicate blk_1073741830_1006 to datanode(s) 127.0.0.1:60511
2015-02-12 16:06:20,674 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0001/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:20,682 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423785972183_0002_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000001.tokens
2015-02-12 16:06:20,682 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:06:20,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,797 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0001/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:20,799 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:06:20,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,907 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 16:06:20,907 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:20,951 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0002/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:20,965 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:06:20,982 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:06:20,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:06:21,046 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0002/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:21,087 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:21,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:21,106 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000001/default_container_executor.sh]
2015-02-12 16:06:21,153 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0002/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:21,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:21,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:21,249 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0002/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:21,250 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:06:21,307 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 16:06:21,307 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:21,484 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000001/default_container_executor.sh]
2015-02-12 16:06:21,562 INFO  datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=3ba35078-bb62-4777-80dc-a38267fd3486, infoPort=60516, ipcPort=60517, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0) Starting thread to transfer BP-2102022600-10.1.1.67-1423785955551:blk_1073741829_1005 to 127.0.0.1:60521 
2015-02-12 16:06:21,564 INFO  datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=3ba35078-bb62-4777-80dc-a38267fd3486, infoPort=60516, ipcPort=60517, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0) Starting thread to transfer BP-2102022600-10.1.1.67-1423785955551:blk_1073741830_1006 to 127.0.0.1:60511 
2015-02-12 16:06:21,570 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741830_1006 src: /127.0.0.1:60616 dest: /127.0.0.1:60511
2015-02-12 16:06:21,570 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741829_1005 src: /127.0.0.1:60615 dest: /127.0.0.1:60521
2015-02-12 16:06:21,574 INFO  datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-2102022600-10.1.1.67-1423785955551:blk_1073741830_1006 (numBytes=254067) to /127.0.0.1:60511
2015-02-12 16:06:21,574 INFO  datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-2102022600-10.1.1.67-1423785955551:blk_1073741829_1005 (numBytes=254067) to /127.0.0.1:60521
2015-02-12 16:06:21,575 INFO  datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-2102022600-10.1.1.67-1423785955551:blk_1073741829_1005 src: /127.0.0.1:60615 dest: /127.0.0.1:60521 of size 254067
2015-02-12 16:06:21,575 INFO  datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-2102022600-10.1.1.67-1423785955551:blk_1073741830_1006 src: /127.0.0.1:60616 dest: /127.0.0.1:60511 of size 254067
2015-02-12 16:06:21,576 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741830_1006 size 254067
2015-02-12 16:06:21,577 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741829_1005 size 254067
2015-02-12 16:06:23,183 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741827_1003
2015-02-12 16:06:24,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:06:24,326 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 16:06:24,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 16:06:24,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 16:06:24,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:06:24,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001	dst=null	perm=null	proto=rpc
2015-02-12 16:06:24,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 16:06:24,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:06:24,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:06:24,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:06:24,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 16:06:24,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 16:06:24,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 16:06:24,597 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002	dst=null	perm=null	proto=rpc
2015-02-12 16:06:24,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 16:06:24,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:06:24,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:06:24,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:06:25,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:06:25,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:06:26,432 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0001_000001 (auth:SIMPLE)
2015-02-12 16:06:26,440 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423785972183_0001_000001
2015-02-12 16:06:26,441 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi	IP=10.1.1.67	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423785972183_0001	APPATTEMPTID=appattempt_1423785972183_0001_000001
2015-02-12 16:06:26,442 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0001_000001 State change from LAUNCHED to RUNNING
2015-02-12 16:06:26,442 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0001 State change from ACCEPTED to RUNNING
2015-02-12 16:06:26,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job_1423785972183_0001_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:06:26,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 16:06:26,662 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30001 milliseconds
2015-02-12 16:06:26,662 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 16:06:26,736 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0002_000001 (auth:SIMPLE)
2015-02-12 16:06:26,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job_1423785972183_0001_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:06:26,754 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423785972183_0002_000001
2015-02-12 16:06:26,755 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi	IP=10.1.1.67	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423785972183_0002	APPATTEMPTID=appattempt_1423785972183_0002_000001
2015-02-12 16:06:26,755 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0002_000001 State change from LAUNCHED to RUNNING
2015-02-12 16:06:26,755 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0002 State change from ACCEPTED to RUNNING
2015-02-12 16:06:26,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job_1423785972183_0002_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:06:26,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 16:06:26,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job_1423785972183_0002_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:06:27,231 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job_1423785972183_0001_1_conf.xml. BP-2102022600-10.1.1.67-1423785955551 blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:06:27,295 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741837_1013 src: /127.0.0.1:60631 dest: /127.0.0.1:60518
2015-02-12 16:06:27,297 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741837_1013 src: /127.0.0.1:60632 dest: /127.0.0.1:60515
2015-02-12 16:06:27,299 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741837_1013 src: /127.0.0.1:60633 dest: /127.0.0.1:60511
2015-02-12 16:06:27,345 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60633, dest: /127.0.0.1:60511, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1199307483_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741837_1013, duration: 44621000
2015-02-12 16:06:27,346 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741837_1013, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:06:27,347 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:27,347 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60632, dest: /127.0.0.1:60515, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1199307483_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741837_1013, duration: 45762000
2015-02-12 16:06:27,347 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741837_1013, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:27,347 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:27,348 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60631, dest: /127.0.0.1:60518, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1199307483_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741837_1013, duration: 47303000
2015-02-12 16:06:27,349 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741837_1013, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:27,350 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:27,357 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job_1423785972183_0001_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1199307483_1
2015-02-12 16:06:27,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job_1423785972183_0001.summary	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:06:27,412 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job_1423785972183_0001.summary. BP-2102022600-10.1.1.67-1423785955551 blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]}
2015-02-12 16:06:27,415 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741838_1014 src: /127.0.0.1:60634 dest: /127.0.0.1:60518
2015-02-12 16:06:27,418 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741838_1014 src: /127.0.0.1:60635 dest: /127.0.0.1:60515
2015-02-12 16:06:27,420 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741838_1014 src: /127.0.0.1:60636 dest: /127.0.0.1:60521
2015-02-12 16:06:27,424 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60636, dest: /127.0.0.1:60521, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1199307483_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741838_1014, duration: 2026000
2015-02-12 16:06:27,424 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741838_1014, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:06:27,426 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:27,426 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60635, dest: /127.0.0.1:60515, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1199307483_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741838_1014, duration: 4132000
2015-02-12 16:06:27,427 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741838_1014, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:27,428 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:27,428 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60634, dest: /127.0.0.1:60518, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1199307483_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741838_1014, duration: 6566000
2015-02-12 16:06:27,429 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741838_1014, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:27,429 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:27,435 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job_1423785972183_0001.summary is closed by DFSClient_NONMAPREDUCE_-1199307483_1
2015-02-12 16:06:27,454 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741832_1008
2015-02-12 16:06:27,456 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741827_1003
2015-02-12 16:06:27,458 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741829_1005
2015-02-12 16:06:27,459 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741828_1004
2015-02-12 16:06:27,460 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741836_1012
2015-02-12 16:06:27,460 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741831_1007
2015-02-12 16:06:27,461 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741835_1011
2015-02-12 16:06:27,462 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741834_1010
2015-02-12 16:06:27,462 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741833_1009
2015-02-12 16:06:27,464 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741830_1006
2015-02-12 16:06:27,480 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741828_1004
2015-02-12 16:06:27,483 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741829_1005
2015-02-12 16:06:27,486 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741830_1006
2015-02-12 16:06:27,487 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741834_1010
2015-02-12 16:06:27,488 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741831_1007
2015-02-12 16:06:27,490 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741832_1008
2015-02-12 16:06:27,491 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741836_1012
2015-02-12 16:06:27,492 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741833_1009
2015-02-12 16:06:27,599 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job_1423785972183_0002_1_conf.xml. BP-2102022600-10.1.1.67-1423785955551 blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]}
2015-02-12 16:06:27,664 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741839_1015 src: /127.0.0.1:60637 dest: /127.0.0.1:60515
2015-02-12 16:06:27,666 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741839_1015 src: /127.0.0.1:60638 dest: /127.0.0.1:60511
2015-02-12 16:06:27,668 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741839_1015 src: /127.0.0.1:60639 dest: /127.0.0.1:60521
2015-02-12 16:06:27,734 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60639, dest: /127.0.0.1:60521, bytes: 113231, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-866148761_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741839_1015, duration: 62884000
2015-02-12 16:06:27,735 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741839_1015, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:06:27,735 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:27,735 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60638, dest: /127.0.0.1:60511, bytes: 113231, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-866148761_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741839_1015, duration: 63313000
2015-02-12 16:06:27,736 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741839_1015, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:27,736 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60637, dest: /127.0.0.1:60515, bytes: 113231, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-866148761_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741839_1015, duration: 64495000
2015-02-12 16:06:27,737 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:27,737 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741839_1015, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:27,737 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:27,749 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job_1423785972183_0002_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-866148761_1
2015-02-12 16:06:27,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job_1423785972183_0002.summary	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:06:27,832 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job_1423785972183_0002.summary. BP-2102022600-10.1.1.67-1423785955551 blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]}
2015-02-12 16:06:27,839 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741840_1016 src: /127.0.0.1:60640 dest: /127.0.0.1:60511
2015-02-12 16:06:27,841 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741840_1016 src: /127.0.0.1:60641 dest: /127.0.0.1:60521
2015-02-12 16:06:27,843 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741840_1016 src: /127.0.0.1:60642 dest: /127.0.0.1:60515
2015-02-12 16:06:27,846 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60642, dest: /127.0.0.1:60515, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-866148761_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741840_1016, duration: 1507000
2015-02-12 16:06:27,847 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741840_1016, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:06:27,847 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:27,847 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60641, dest: /127.0.0.1:60521, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-866148761_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741840_1016, duration: 2404000
2015-02-12 16:06:27,848 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741840_1016, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:27,848 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:27,848 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60640, dest: /127.0.0.1:60511, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-866148761_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741840_1016, duration: 3513000
2015-02-12 16:06:27,849 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741840_1016, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:27,849 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:27,851 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job_1423785972183_0002.summary is closed by DFSClient_NONMAPREDUCE_-866148761_1
2015-02-12 16:06:27,881 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741827_1003
2015-02-12 16:06:27,885 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741830_1006
2015-02-12 16:06:27,886 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741828_1004
2015-02-12 16:06:27,886 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741832_1008
2015-02-12 16:06:27,887 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741831_1007
2015-02-12 16:06:27,887 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741834_1010
2015-02-12 16:06:27,890 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741829_1005
2015-02-12 16:06:27,890 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741833_1009
2015-02-12 16:06:27,891 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741836_1012
2015-02-12 16:06:27,892 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741835_1011
2015-02-12 16:06:27,983 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:06:27,983 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000002
2015-02-12 16:06:27,983 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0001_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 16:06:27,984 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:06:27,984 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000002
2015-02-12 16:06:27,984 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0002_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 16:06:28,042 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:06:28,042 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000003
2015-02-12 16:06:28,042 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0001_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 16:06:28,188 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741835_1011
2015-02-12 16:06:28,190 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741830_1006
2015-02-12 16:06:28,191 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741832_1008
2015-02-12 16:06:28,191 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741831_1007
2015-02-12 16:06:28,193 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741829_1005
2015-02-12 16:06:28,299 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:06:28,299 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000003
2015-02-12 16:06:28,299 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0002_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 16:06:28,643 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60564 for container : container_1423785972183_0001_01_000002
2015-02-12 16:06:28,644 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:06:28,645 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60560 for container : container_1423785972183_0001_01_000003
2015-02-12 16:06:28,646 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:06:28,684 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:28,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:28,696 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:28,697 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:28,700 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:28,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:28,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:28,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:28,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:28,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:28,792 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0001_000001 (auth:SIMPLE)
2015-02-12 16:06:28,792 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0001_000001 (auth:SIMPLE)
2015-02-12 16:06:28,797 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0001_01_000002 by user soberoi
2015-02-12 16:06:28,797 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0001_01_000003 by user soberoi
2015-02-12 16:06:28,798 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0001
2015-02-12 16:06:28,798 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0001
2015-02-12 16:06:28,799 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0001 transitioned from NEW to INITING
2015-02-12 16:06:28,799 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0001 transitioned from NEW to INITING
2015-02-12 16:06:28,799 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0001_01_000002 to application application_1423785972183_0001
2015-02-12 16:06:28,798 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000002
2015-02-12 16:06:28,799 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0001_01_000003 to application application_1423785972183_0001
2015-02-12 16:06:28,800 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0001 transitioned from INITING to RUNNING
2015-02-12 16:06:28,799 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000003
2015-02-12 16:06:28,803 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0001 transitioned from INITING to RUNNING
2015-02-12 16:06:28,803 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 16:06:28,805 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 16:06:28,805 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0001
2015-02-12 16:06:28,805 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0001
2015-02-12 16:06:28,805 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:06:28,805 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0001
2015-02-12 16:06:28,805 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0001
2015-02-12 16:06:28,806 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:06:28,806 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0001
2015-02-12 16:06:28,806 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0001
2015-02-12 16:06:28,806 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:06:28,806 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:06:28,806 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:06:28,807 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:06:28,807 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:06:28,807 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar, 1423785959300, FILE, null }
2015-02-12 16:06:28,806 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:06:28,808 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:06:28,808 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:06:28,808 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar, 1423785959300, FILE, null }
2015-02-12 16:06:28,821 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60568 for container : container_1423785972183_0002_01_000002
2015-02-12 16:06:28,822 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:06:28,822 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60556 for container : container_1423785972183_0002_01_000003
2015-02-12 16:06:28,823 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:06:28,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:28,890 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:28,905 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:28,907 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:28,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:28,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:28,956 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423785959163, FILE, null }
2015-02-12 16:06:28,959 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(755)) - Downloading public rsrc:{ hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1423785959163, FILE, null }
2015-02-12 16:06:28,995 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:06:28,995 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000004
2015-02-12 16:06:28,995 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0001_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 16:06:28,996 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:06:28,997 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:06:28,997 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000004
2015-02-12 16:06:28,997 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0002_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 16:06:29,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,012 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,015 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,018 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,020 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,021 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,025 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,026 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,061 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:06:29,062 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:06:29,062 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000005
2015-02-12 16:06:29,062 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0001_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 16:06:29,108 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/filecache/10/hadoop-3483439372465658835.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:29,109 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/filecache/10/hadoop-3483439372465658835.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:29,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,117 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,201 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0001_01_000002
2015-02-12 16:06:29,224 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0001_01_000003
2015-02-12 16:06:29,227 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423785972183_0001_01_000002.tokens. Credentials list: 
2015-02-12 16:06:29,249 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423785972183_0001_01_000003.tokens. Credentials list: 
2015-02-12 16:06:29,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,252 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:29,300 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0002_000001 (auth:SIMPLE)
2015-02-12 16:06:29,303 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:06:29,303 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000005
2015-02-12 16:06:29,303 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0002_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 16:06:29,318 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0002_01_000003 by user soberoi
2015-02-12 16:06:29,318 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0002
2015-02-12 16:06:29,318 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000003
2015-02-12 16:06:29,319 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0002 transitioned from NEW to INITING
2015-02-12 16:06:29,319 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0002_01_000003 to application application_1423785972183_0002
2015-02-12 16:06:29,319 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0002 transitioned from INITING to RUNNING
2015-02-12 16:06:29,320 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 16:06:29,320 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0002
2015-02-12 16:06:29,320 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0002
2015-02-12 16:06:29,320 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:06:29,320 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0002
2015-02-12 16:06:29,320 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:06:29,321 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:06:29,321 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0002_01_000003
2015-02-12 16:06:29,339 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/filecache/11/MRAppJar.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:29,339 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423785972183_0002_01_000003.tokens. Credentials list: 
2015-02-12 16:06:29,348 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/filecache/11/MRAppJar.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:29,358 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0002_000001 (auth:SIMPLE)
2015-02-12 16:06:29,389 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0002_01_000002 by user soberoi
2015-02-12 16:06:29,390 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000002
2015-02-12 16:06:29,390 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0002_01_000002 to application application_1423785972183_0002
2015-02-12 16:06:29,391 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 16:06:29,391 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0002
2015-02-12 16:06:29,391 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0002
2015-02-12 16:06:29,391 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:06:29,391 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0002
2015-02-12 16:06:29,395 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:06:29,461 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 16:06:29,462 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:29,477 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:06:29,502 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:06:29,601 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:06:29,662 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60568 for container : container_1423785972183_0001_01_000004
2015-02-12 16:06:29,664 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:06:29,665 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:06:29,676 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0001_000001 (auth:SIMPLE)
2015-02-12 16:06:29,678 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0001_000001 (auth:SIMPLE)
2015-02-12 16:06:29,684 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0001_01_000005 by user soberoi
2015-02-12 16:06:29,684 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0001_01_000004 by user soberoi
2015-02-12 16:06:29,684 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0001
2015-02-12 16:06:29,684 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000005
2015-02-12 16:06:29,684 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000004
2015-02-12 16:06:29,684 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0001_01_000005 to application application_1423785972183_0001
2015-02-12 16:06:29,685 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0001 transitioned from NEW to INITING
2015-02-12 16:06:29,692 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0001_01_000004 to application application_1423785972183_0001
2015-02-12 16:06:29,693 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0001 transitioned from INITING to RUNNING
2015-02-12 16:06:29,693 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 16:06:29,694 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0001
2015-02-12 16:06:29,694 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0001
2015-02-12 16:06:29,694 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:06:29,694 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 16:06:29,694 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0001
2015-02-12 16:06:29,696 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:06:29,696 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:06:29,697 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0001_01_000004
2015-02-12 16:06:29,695 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0001
2015-02-12 16:06:29,698 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0001
2015-02-12 16:06:29,698 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:06:29,698 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0001
2015-02-12 16:06:29,699 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0001_01_000005
2015-02-12 16:06:29,724 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423785972183_0001_01_000004.tokens. Credentials list: 
2015-02-12 16:06:29,732 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423785972183_0001_01_000005.tokens. Credentials list: 
2015-02-12 16:06:29,772 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423785972183_0001_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000003.tokens
2015-02-12 16:06:29,773 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:06:29,778 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423785972183_0001_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000002.tokens
2015-02-12 16:06:29,785 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:06:29,792 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000002/default_container_executor.sh]
2015-02-12 16:06:29,840 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60564 for container : container_1423785972183_0002_01_000004
2015-02-12 16:06:29,841 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:06:29,841 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:06:29,857 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0002_000001 (auth:SIMPLE)
2015-02-12 16:06:29,859 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0002_000001 (auth:SIMPLE)
2015-02-12 16:06:29,863 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0002_01_000004 by user soberoi
2015-02-12 16:06:29,864 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0002
2015-02-12 16:06:29,864 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000004
2015-02-12 16:06:29,864 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0002_01_000005 by user soberoi
2015-02-12 16:06:29,867 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000005
2015-02-12 16:06:29,864 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0002 transitioned from NEW to INITING
2015-02-12 16:06:29,868 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0002_01_000004 to application application_1423785972183_0002
2015-02-12 16:06:29,868 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0002 transitioned from INITING to RUNNING
2015-02-12 16:06:29,868 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 16:06:29,868 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0002
2015-02-12 16:06:29,868 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0002
2015-02-12 16:06:29,868 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:06:29,869 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0002
2015-02-12 16:06:29,869 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0002_01_000005 to application application_1423785972183_0002
2015-02-12 16:06:29,869 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:06:29,869 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:06:29,869 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 16:06:29,869 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0002_01_000004
2015-02-12 16:06:29,869 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0002
2015-02-12 16:06:29,870 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0002
2015-02-12 16:06:29,870 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:06:29,870 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0002
2015-02-12 16:06:29,871 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0002_01_000005
2015-02-12 16:06:29,903 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423785972183_0002_01_000005.tokens. Credentials list: 
2015-02-12 16:06:29,911 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423785972183_0002_01_000004.tokens. Credentials list: 
2015-02-12 16:06:29,981 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423785972183_0002_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000003.tokens
2015-02-12 16:06:29,982 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:06:30,003 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:06:30,018 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:06:30,018 INFO  fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423785972183_0001
2015-02-12 16:06:30,019 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000006 Container Transitioned from NEW to RESERVED
2015-02-12 16:06:30,019 INFO  fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423785972183_0001_01_000006 on node host: 10.1.1.67:60568 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@3aa1eab
2015-02-12 16:06:30,020 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:06:30,020 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:06:30,020 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000007
2015-02-12 16:06:30,020 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0001_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 16:06:30,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:30,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:30,067 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:06:30,068 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:06:30,068 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000006
2015-02-12 16:06:30,068 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0002_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 16:06:30,072 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:06:30,183 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:30,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:30,198 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0001/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:30,252 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:30,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:30,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:30,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:30,275 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0001/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:30,327 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:06:30,328 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:06:30,328 INFO  fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423785972183_0001
2015-02-12 16:06:30,328 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000008 Container Transitioned from NEW to RESERVED
2015-02-12 16:06:30,328 INFO  fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423785972183_0001_01_000008 on node host: 10.1.1.67:60556 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@3aa1eab
2015-02-12 16:06:30,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:30,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:30,346 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423785972183_0001_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000004.tokens
2015-02-12 16:06:30,346 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:06:30,367 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0001/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:30,367 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:06:30,372 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:06:30,377 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0002/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:30,416 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0001/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:30,416 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:06:30,455 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 16:06:30,455 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:30,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:30,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:30,471 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 16:06:30,471 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:30,480 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 16:06:30,480 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:30,600 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0002/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:30,600 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:06:30,600 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:06:30,672 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:06:30,683 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0001_000001 (auth:SIMPLE)
2015-02-12 16:06:30,685 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0001_01_000007 by user soberoi
2015-02-12 16:06:30,686 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000007
2015-02-12 16:06:30,686 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0001_01_000007 to application application_1423785972183_0001
2015-02-12 16:06:30,686 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 16:06:30,687 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0001
2015-02-12 16:06:30,687 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0001
2015-02-12 16:06:30,687 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:06:30,687 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0001
2015-02-12 16:06:30,690 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 16:06:30,690 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:30,695 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:06:30,696 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 16:06:30,696 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:30,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:30,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:30,783 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 16:06:30,783 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:30,823 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0001/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:30,850 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60560 for container : container_1423785972183_0002_01_000006
2015-02-12 16:06:30,851 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:06:30,860 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0002_000001 (auth:SIMPLE)
2015-02-12 16:06:30,865 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0002_01_000006 by user soberoi
2015-02-12 16:06:30,865 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0002
2015-02-12 16:06:30,865 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000006
2015-02-12 16:06:30,865 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0002 transitioned from NEW to INITING
2015-02-12 16:06:30,865 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0002_01_000006 to application application_1423785972183_0002
2015-02-12 16:06:30,866 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0002 transitioned from INITING to RUNNING
2015-02-12 16:06:30,866 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 16:06:30,866 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0002
2015-02-12 16:06:30,866 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0002
2015-02-12 16:06:30,866 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:06:30,867 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0002
2015-02-12 16:06:30,867 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:06:30,867 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:06:30,867 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0002_01_000006
2015-02-12 16:06:30,898 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000005/default_container_executor.sh]
2015-02-12 16:06:30,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:30,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:30,908 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423785972183_0002_01_000006.tokens. Credentials list: 
2015-02-12 16:06:30,948 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000003/default_container_executor.sh]
2015-02-12 16:06:30,952 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000002/default_container_executor.sh]
2015-02-12 16:06:30,994 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0001/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:30,994 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:06:31,058 INFO  fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423785972183_0001_000001 on node host: 10.1.1.67:60568 #containers=3 available=0 used=4096
2015-02-12 16:06:31,059 INFO  fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423785972183_0001 unreserved  on node host: 10.1.1.67:60568 #containers=3 available=0 used=4096, currently has 1 at priority 20; currentReservation <memory:1024, vCores:1>
2015-02-12 16:06:31,059 INFO  fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423785972183_0001
2015-02-12 16:06:31,059 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000009 Container Transitioned from NEW to RESERVED
2015-02-12 16:06:31,059 INFO  fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423785972183_0001_01_000009 on node host: 10.1.1.67:60568 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@3aa1eab
2015-02-12 16:06:31,059 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:06:31,060 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000010 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:06:31,061 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000010
2015-02-12 16:06:31,061 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0001_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 16:06:31,069 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:06:31,070 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:06:31,070 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000007
2015-02-12 16:06:31,070 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0002_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 16:06:31,159 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000005/default_container_executor.sh]
2015-02-12 16:06:31,182 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000003/default_container_executor.sh]
2015-02-12 16:06:31,196 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 16:06:31,196 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:31,241 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000007/default_container_executor.sh]
2015-02-12 16:06:31,302 INFO  fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423785972183_0001_000001 on node host: 10.1.1.67:60556 #containers=3 available=0 used=4096
2015-02-12 16:06:31,302 INFO  fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423785972183_0001 unreserved  on node host: 10.1.1.67:60556 #containers=3 available=0 used=4096, currently has 1 at priority 20; currentReservation <memory:1024, vCores:1>
2015-02-12 16:06:31,413 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:06:31,456 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:06:31,488 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000004/default_container_executor.sh]
2015-02-12 16:06:31,623 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423785972183_0002_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000006.tokens
2015-02-12 16:06:31,624 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:06:31,635 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:06:31,643 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423785972183_0002_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000004.tokens
2015-02-12 16:06:31,644 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:06:31,679 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 16:06:31,681 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000010 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:06:31,857 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 16:06:31,858 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:06:31,891 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423785972183_0002_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000005.tokens
2015-02-12 16:06:31,893 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:06:31,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:31,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:31,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:31,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:06:32,001 INFO  fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423785972183_0001_000001 on node host: 10.1.1.67:60568 #containers=3 available=0 used=4096
2015-02-12 16:06:32,001 INFO  fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423785972183_0001 unreserved  on node host: 10.1.1.67:60568 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 16:06:32,027 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0002/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:32,042 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0002/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:32,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:32,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:32,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:32,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:06:32,134 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0002/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:32,134 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:06:32,213 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0002/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:06:32,213 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:06:32,277 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 16:06:32,277 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:32,299 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 16:06:32,299 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:32,472 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741837_1013
2015-02-12 16:06:32,498 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741837_1013
2015-02-12 16:06:32,499 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741838_1014
2015-02-12 16:06:32,647 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000006/default_container_executor.sh]
2015-02-12 16:06:32,686 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000010 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:06:32,686 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0001_01_000010 in state: RELEASED event:RELEASED
2015-02-12 16:06:32,686 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000010
2015-02-12 16:06:32,693 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0001_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 16:06:32,696 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0001_000001 released container container_1423785972183_0001_01_000010 on node: host: 10.1.1.67:60564 #containers=3 available=1024 used=3072 with event: RELEASED
2015-02-12 16:06:32,711 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000004/default_container_executor.sh]
2015-02-12 16:06:32,862 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000007 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:06:32,863 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0002_01_000007 in state: RELEASED event:RELEASED
2015-02-12 16:06:32,863 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000007
2015-02-12 16:06:32,866 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0002_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 16:06:32,867 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0002_000001 released container container_1423785972183_0002_01_000007 on node: host: 10.1.1.67:60560 #containers=3 available=1024 used=3072 with event: RELEASED
2015-02-12 16:06:32,896 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741838_1014
2015-02-12 16:06:32,897 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741837_1013
2015-02-12 16:06:33,007 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0001_01_000010
2015-02-12 16:06:33,064 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0002_01_000007
2015-02-12 16:06:33,197 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741840_1016
2015-02-12 16:06:33,197 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741838_1014
2015-02-12 16:06:33,198 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741839_1015
2015-02-12 16:06:33,246 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:06:33,397 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423785972183_0001_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000005.tokens
2015-02-12 16:06:33,397 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:06:37,478 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741839_1015
2015-02-12 16:06:37,482 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741840_1016
2015-02-12 16:06:37,506 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741839_1015
2015-02-12 16:06:37,506 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741840_1016
2015-02-12 16:06:40,688 INFO  hs.JobHistory (JobHistory.java:run(198)) - History Cleaner started
2015-02-12 16:06:40,692 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=null	proto=rpc
2015-02-12 16:06:40,692 INFO  hs.JobHistory (JobHistory.java:run(204)) - History Cleaner complete
2015-02-12 16:06:49,912 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:50,070 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:50,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:50,218 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:50,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:50,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:50,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:50,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:50,849 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:06:50,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:50,890 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:06:50,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:06:51,013 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:06:51,143 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:06:51,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:06:51,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:06:51,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:06:51,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:06:51,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:06:51,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:06:52,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_temporary/1/_temporary/attempt_1423785972183_0002_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 16:06:52,615 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0002_000001 (auth:SIMPLE)
2015-02-12 16:06:52,619 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0002_01_000002
2015-02-12 16:06:52,620 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000002
2015-02-12 16:06:52,620 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000002 transitioned from RUNNING to KILLING
2015-02-12 16:06:52,620 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0002_01_000002
2015-02-12 16:06:52,643 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job_1423785972183_0002_1.jhist. BP-2102022600-10.1.1.67-1423785955551 blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]}
2015-02-12 16:06:52,645 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741841_1017 src: /127.0.0.1:60730 dest: /127.0.0.1:60518
2015-02-12 16:06:52,647 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741841_1017 src: /127.0.0.1:60731 dest: /127.0.0.1:60515
2015-02-12 16:06:52,649 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0002_01_000002 is : 143
2015-02-12 16:06:52,649 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741841_1017 src: /127.0.0.1:60732 dest: /127.0.0.1:60521
2015-02-12 16:06:52,660 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job_1423785972183_0002_1.jhist for DFSClient_NONMAPREDUCE_-866148761_1
2015-02-12 16:06:52,665 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:06:52,667 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000002
2015-02-12 16:06:52,669 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000002
2015-02-12 16:06:52,670 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000002
2015-02-12 16:06:52,672 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:06:52,672 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0002_01_000002 from application application_1423785972183_0002
2015-02-12 16:06:52,672 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:52,672 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000002
2015-02-12 16:06:52,672 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000002
2015-02-12 16:06:52,672 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0002
2015-02-12 16:06:52,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_temporary/1/_temporary/attempt_1423785972183_0001_m_000004_0	dst=null	perm=null	proto=rpc
2015-02-12 16:06:52,804 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0001_000001 (auth:SIMPLE)
2015-02-12 16:06:52,806 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0001_01_000007
2015-02-12 16:06:52,807 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000007
2015-02-12 16:06:52,807 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000007 transitioned from RUNNING to KILLING
2015-02-12 16:06:52,807 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0001_01_000007
2015-02-12 16:06:52,827 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job_1423785972183_0001_1.jhist. BP-2102022600-10.1.1.67-1423785955551 blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]}
2015-02-12 16:06:52,828 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0001_01_000007 is : 143
2015-02-12 16:06:52,829 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741842_1018 src: /127.0.0.1:60736 dest: /127.0.0.1:60511
2015-02-12 16:06:52,831 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741842_1018 src: /127.0.0.1:60737 dest: /127.0.0.1:60515
2015-02-12 16:06:52,832 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741842_1018 src: /127.0.0.1:60738 dest: /127.0.0.1:60521
2015-02-12 16:06:52,842 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:06:52,842 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job_1423785972183_0001_1.jhist for DFSClient_NONMAPREDUCE_-1199307483_1
2015-02-12 16:06:52,843 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000007
2015-02-12 16:06:52,844 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000007
2015-02-12 16:06:52,844 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000007
2015-02-12 16:06:52,844 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000007
2015-02-12 16:06:52,844 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000007
2015-02-12 16:06:52,844 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:06:52,846 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0001_01_000007 from application application_1423785972183_0001
2015-02-12 16:06:52,846 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:52,846 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0001
2015-02-12 16:06:52,928 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_temporary/1/_temporary/attempt_1423785972183_0001_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 16:06:52,981 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0001_000001 (auth:SIMPLE)
2015-02-12 16:06:52,983 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0001_01_000003
2015-02-12 16:06:52,984 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000003
2015-02-12 16:06:52,984 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000003 transitioned from RUNNING to KILLING
2015-02-12 16:06:52,984 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0001_01_000003
2015-02-12 16:06:53,009 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0001_01_000003 is : 143
2015-02-12 16:06:53,026 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:06:53,027 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000003
2015-02-12 16:06:53,031 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000003
2015-02-12 16:06:53,044 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000003
2015-02-12 16:06:53,046 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000003
2015-02-12 16:06:53,049 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000003
2015-02-12 16:06:53,049 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:06:53,049 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0001_01_000003 from application application_1423785972183_0001
2015-02-12 16:06:53,049 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:53,049 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0001
2015-02-12 16:06:53,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_temporary/1/_temporary/attempt_1423785972183_0001_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 16:06:53,147 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0001_000001 (auth:SIMPLE)
2015-02-12 16:06:53,149 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0001_01_000005
2015-02-12 16:06:53,149 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000005
2015-02-12 16:06:53,150 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000005 transitioned from RUNNING to KILLING
2015-02-12 16:06:53,150 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0001_01_000005
2015-02-12 16:06:53,151 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:06:53,151 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0001_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 16:06:53,151 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000003
2015-02-12 16:06:53,152 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0001_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 16:06:53,153 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0001_000001 released container container_1423785972183_0001_01_000003 on node: host: 10.1.1.67:60560 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 16:06:53,185 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0001_01_000005 is : 143
2015-02-12 16:06:53,209 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:06:53,210 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000005
2015-02-12 16:06:53,211 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000005
2015-02-12 16:06:53,211 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:06:53,211 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000005
2015-02-12 16:06:53,211 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000005
2015-02-12 16:06:53,212 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000005
2015-02-12 16:06:53,211 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0001_01_000005 from application application_1423785972183_0001
2015-02-12 16:06:53,213 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:53,214 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0001
2015-02-12 16:06:53,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_temporary/1/_temporary/attempt_1423785972183_0002_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 16:06:53,286 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0002_000001 (auth:SIMPLE)
2015-02-12 16:06:53,288 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0002_01_000005
2015-02-12 16:06:53,289 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000005
2015-02-12 16:06:53,289 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000005 transitioned from RUNNING to KILLING
2015-02-12 16:06:53,289 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0002_01_000005
2015-02-12 16:06:53,310 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0002_01_000005 is : 143
2015-02-12 16:06:53,352 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:06:53,353 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000005
2015-02-12 16:06:53,353 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000005
2015-02-12 16:06:53,354 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000005
2015-02-12 16:06:53,354 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000005
2015-02-12 16:06:53,354 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000005
2015-02-12 16:06:53,354 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:06:53,354 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0002_01_000005 from application application_1423785972183_0002
2015-02-12 16:06:53,355 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:53,355 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0002
2015-02-12 16:06:53,357 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_temporary/1/_temporary/attempt_1423785972183_0002_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 16:06:53,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_temporary/1/_temporary/attempt_1423785972183_0001_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 16:06:53,381 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0002_000001 (auth:SIMPLE)
2015-02-12 16:06:53,383 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0002_01_000003
2015-02-12 16:06:53,384 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000003
2015-02-12 16:06:53,384 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000003 transitioned from RUNNING to KILLING
2015-02-12 16:06:53,384 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:06:53,385 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0002_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 16:06:53,385 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000005
2015-02-12 16:06:53,385 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0002_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 16:06:53,385 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0002_000001 released container container_1423785972183_0002_01_000005 on node: host: 10.1.1.67:60556 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 16:06:53,384 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0002_01_000003
2015-02-12 16:06:53,420 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0002_01_000003 is : 143
2015-02-12 16:06:53,441 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0001_000001 (auth:SIMPLE)
2015-02-12 16:06:53,444 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0001_01_000004
2015-02-12 16:06:53,444 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000004
2015-02-12 16:06:53,444 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000004 transitioned from RUNNING to KILLING
2015-02-12 16:06:53,445 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0001_01_000004
2015-02-12 16:06:53,446 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:06:53,446 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0002_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 16:06:53,446 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000002
2015-02-12 16:06:53,446 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0002_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 16:06:53,446 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0002_000001 released container container_1423785972183_0002_01_000002 on node: host: 10.1.1.67:60568 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 16:06:53,453 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:06:53,454 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000003
2015-02-12 16:06:53,455 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000003
2015-02-12 16:06:53,460 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000003
2015-02-12 16:06:53,465 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000003
2015-02-12 16:06:53,467 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0001_01_000004 is : 143
2015-02-12 16:06:53,468 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000003
2015-02-12 16:06:53,469 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:06:53,469 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0002_01_000003 from application application_1423785972183_0002
2015-02-12 16:06:53,469 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:53,469 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0002
2015-02-12 16:06:53,477 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:06:53,477 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000004
2015-02-12 16:06:53,478 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000004
2015-02-12 16:06:53,479 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000004
2015-02-12 16:06:53,479 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000004
2015-02-12 16:06:53,480 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000004
2015-02-12 16:06:53,482 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:06:53,482 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0001_01_000004 from application application_1423785972183_0001
2015-02-12 16:06:53,483 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:53,483 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0001
2015-02-12 16:06:53,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_temporary/1/_temporary/attempt_1423785972183_0002_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 16:06:53,572 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0002_000001 (auth:SIMPLE)
2015-02-12 16:06:53,574 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0002_01_000004
2015-02-12 16:06:53,574 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000004
2015-02-12 16:06:53,574 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000004 transitioned from RUNNING to KILLING
2015-02-12 16:06:53,574 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0002_01_000004
2015-02-12 16:06:53,575 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:06:53,575 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0001_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 16:06:53,575 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000007
2015-02-12 16:06:53,576 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0001_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 16:06:53,576 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0001_000001 released container container_1423785972183_0001_01_000007 on node: host: 10.1.1.67:60564 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 16:06:53,594 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0002_01_000004 is : 143
2015-02-12 16:06:53,604 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:06:53,606 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000004
2015-02-12 16:06:53,606 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000004
2015-02-12 16:06:53,607 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000004
2015-02-12 16:06:53,609 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000004
2015-02-12 16:06:53,610 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000004
2015-02-12 16:06:53,610 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:06:53,611 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0002_01_000004 from application application_1423785972183_0002
2015-02-12 16:06:53,611 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:53,611 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0002
2015-02-12 16:06:53,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_temporary/1/_temporary/attempt_1423785972183_0001_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 16:06:53,654 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0001_000001 (auth:SIMPLE)
2015-02-12 16:06:53,656 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0001_01_000002
2015-02-12 16:06:53,656 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000002
2015-02-12 16:06:53,657 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:53,658 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:06:53,658 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0002_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 16:06:53,658 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000004
2015-02-12 16:06:53,658 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0002_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 16:06:53,658 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0002_000001 released container container_1423785972183_0002_01_000004 on node: host: 10.1.1.67:60564 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 16:06:53,659 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000002 transitioned from RUNNING to KILLING
2015-02-12 16:06:53,659 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0001_01_000002
2015-02-12 16:06:53,681 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0001_01_000002 is : 143
2015-02-12 16:06:53,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_temporary/1/_temporary/attempt_1423785972183_0002_m_000004_0	dst=null	perm=null	proto=rpc
2015-02-12 16:06:53,704 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:06:53,705 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000002
2015-02-12 16:06:53,706 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000002
2015-02-12 16:06:53,706 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000002
2015-02-12 16:06:53,707 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000002
2015-02-12 16:06:53,708 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000002
2015-02-12 16:06:53,709 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:06:53,709 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0001_01_000002 from application application_1423785972183_0001
2015-02-12 16:06:53,709 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:53,709 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0001
2015-02-12 16:06:53,744 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0002_000001 (auth:SIMPLE)
2015-02-12 16:06:53,747 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0002_01_000006
2015-02-12 16:06:53,747 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000006
2015-02-12 16:06:53,747 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000006 transitioned from RUNNING to KILLING
2015-02-12 16:06:53,747 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0002_01_000006
2015-02-12 16:06:53,748 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:53,748 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:06:53,748 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0001_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 16:06:53,748 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000005
2015-02-12 16:06:53,748 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0001_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 16:06:53,748 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0001_000001 released container container_1423785972183_0001_01_000005 on node: host: 10.1.1.67:60560 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 16:06:53,772 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0002_01_000006 is : 143
2015-02-12 16:06:53,784 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:06:53,784 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000006
2015-02-12 16:06:53,785 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000006
2015-02-12 16:06:53,785 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000006
2015-02-12 16:06:53,788 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000006
2015-02-12 16:06:53,789 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000006
2015-02-12 16:06:53,789 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:06:53,791 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0002_01_000006 from application application_1423785972183_0002
2015-02-12 16:06:53,791 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:53,791 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0002
2015-02-12 16:06:54,390 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:06:54,391 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0002_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 16:06:54,391 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000003
2015-02-12 16:06:54,391 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0002_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 16:06:54,391 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0002_000001 released container container_1423785972183_0002_01_000003 on node: host: 10.1.1.67:60556 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 16:06:54,392 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:54,393 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:06:54,393 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000008
2015-02-12 16:06:54,393 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0002_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 16:06:54,452 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:06:54,452 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0001_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 16:06:54,452 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000004
2015-02-12 16:06:54,453 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0001_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 16:06:54,453 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0001_000001 released container container_1423785972183_0001_01_000004 on node: host: 10.1.1.67:60568 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 16:06:54,453 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:54,659 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:06:54,659 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0001_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 16:06:54,660 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000002
2015-02-12 16:06:54,660 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0001_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 16:06:54,660 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0001_000001 released container container_1423785972183_0001_01_000002 on node: host: 10.1.1.67:60564 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 16:06:54,660 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:54,660 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:54,751 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:54,751 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:54,751 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:06:54,751 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0002_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 16:06:54,752 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000006
2015-02-12 16:06:54,752 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0002_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 16:06:54,752 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0002_000001 released container container_1423785972183_0002_01_000006 on node: host: 10.1.1.67:60560 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 16:06:54,989 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:06:55,000 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0002_000001 (auth:SIMPLE)
2015-02-12 16:06:55,002 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0002_01_000008 by user soberoi
2015-02-12 16:06:55,002 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000008
2015-02-12 16:06:55,002 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0002_01_000008 to application application_1423785972183_0002
2015-02-12 16:06:55,003 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 16:06:55,004 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0002
2015-02-12 16:06:55,004 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0002
2015-02-12 16:06:55,004 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:06:55,004 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0002
2015-02-12 16:06:55,005 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:06:55,038 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 16:06:55,039 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:55,148 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000008/default_container_executor.sh]
2015-02-12 16:06:55,397 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0002_01_000005]
2015-02-12 16:06:55,397 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:06:55,397 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:55,397 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:55,398 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000011 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:06:55,398 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000011
2015-02-12 16:06:55,398 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0001_01_000011 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 16:06:55,457 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0002_01_000002]
2015-02-12 16:06:55,457 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:55,457 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:55,660 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:55,660 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:55,660 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:55,660 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0002_01_000004, container_1423785972183_0001_01_000007]
2015-02-12 16:06:55,753 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:55,753 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0001_01_000005, container_1423785972183_0001_01_000003]
2015-02-12 16:06:55,754 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:55,754 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:55,824 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60556 for container : container_1423785972183_0001_01_000011
2015-02-12 16:06:55,825 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000011 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:06:55,844 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0001_000001 (auth:SIMPLE)
2015-02-12 16:06:55,847 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0001_01_000011 by user soberoi
2015-02-12 16:06:55,849 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000011
2015-02-12 16:06:55,849 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0001_01_000011 to application application_1423785972183_0001
2015-02-12 16:06:55,850 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000011 transitioned from NEW to LOCALIZING
2015-02-12 16:06:55,850 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0001
2015-02-12 16:06:55,850 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0001
2015-02-12 16:06:55,850 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:06:55,850 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0001
2015-02-12 16:06:55,851 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000011 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:06:55,904 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000011 transitioned from LOCALIZED to RUNNING
2015-02-12 16:06:55,904 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:06:55,995 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 16:06:56,066 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000011/default_container_executor.sh]
2015-02-12 16:06:56,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0002_01_000003]
2015-02-12 16:06:56,401 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000011 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:06:56,401 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:56,460 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0001_01_000004]
2015-02-12 16:06:56,461 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:56,664 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30003 milliseconds
2015-02-12 16:06:56,664 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0001_01_000002]
2015-02-12 16:06:56,664 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 16:06:56,664 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:56,759 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0002_01_000006]
2015-02-12 16:06:56,759 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:06:56,830 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 16:06:59,319 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 16:06:59,323 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 16:06:59,326 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 16:06:59,327 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 16:06:59,632 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(690)) - Number of transactions: 143 Total time for transactions(ms): 25 Number of transactions batched in Syncs: 0 Number of syncs: 83 SyncTimes(ms): 23 23 
2015-02-12 16:06:59,633 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_temporary/1/_temporary/attempt_1423785972183_0002_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:06:59,686 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_temporary/1/_temporary/attempt_1423785972183_0002_r_000000_0/part-00000. BP-2102022600-10.1.1.67-1423785955551 blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]}
2015-02-12 16:06:59,816 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741843_1019 src: /127.0.0.1:60764 dest: /127.0.0.1:60521
2015-02-12 16:06:59,818 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741843_1019 src: /127.0.0.1:60765 dest: /127.0.0.1:60518
2015-02-12 16:06:59,819 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741843_1019 src: /127.0.0.1:60766 dest: /127.0.0.1:60515
2015-02-12 16:06:59,870 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60766, dest: /127.0.0.1:60515, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1423785972183_0002_r_000000_0_1262071207_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741843_1019, duration: 49095000
2015-02-12 16:06:59,870 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741843_1019, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:06:59,871 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]} size 0
2015-02-12 16:06:59,872 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60765, dest: /127.0.0.1:60518, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1423785972183_0002_r_000000_0_1262071207_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741843_1019, duration: 50644000
2015-02-12 16:06:59,872 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741843_1019, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:59,873 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60764, dest: /127.0.0.1:60521, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1423785972183_0002_r_000000_0_1262071207_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741843_1019, duration: 52353000
2015-02-12 16:06:59,874 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741843_1019, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:06:59,876 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:59,877 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:06:59,894 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_temporary/1/_temporary/attempt_1423785972183_0002_r_000000_0/part-00000 is closed by DFSClient_attempt_1423785972183_0002_r_000000_0_1262071207_1
2015-02-12 16:06:59,934 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_temporary/1/_temporary/attempt_1423785972183_0002_r_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 16:06:59,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_temporary/1/_temporary/attempt_1423785972183_0002_r_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 16:06:59,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_temporary/1/task_1423785972183_0002_r_000000	dst=null	perm=null	proto=rpc
2015-02-12 16:06:59,954 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_temporary/1/_temporary/attempt_1423785972183_0002_r_000000_0	dst=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_temporary/1/task_1423785972183_0002_r_000000	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 16:06:59,975 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0002_000001 (auth:SIMPLE)
2015-02-12 16:06:59,978 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0002_01_000008
2015-02-12 16:06:59,978 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000008
2015-02-12 16:06:59,979 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000008 transitioned from RUNNING to KILLING
2015-02-12 16:06:59,979 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0002_01_000008
2015-02-12 16:06:59,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:06:59,997 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-866148761_1
2015-02-12 16:07:00,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_temporary/1	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,015 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0002_01_000008 is : 143
2015-02-12 16:07:00,022 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_temporary/1/task_1423785972183_0002_r_000000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,034 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:07:00,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,035 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000008
2015-02-12 16:07:00,035 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000008
2015-02-12 16:07:00,036 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000008
2015-02-12 16:07:00,038 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000008
2015-02-12 16:07:00,040 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000008
2015-02-12 16:07:00,041 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:07:00,041 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0002_01_000008 from application application_1423785972183_0002
2015-02-12 16:07:00,041 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:00,042 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0002
2015-02-12 16:07:00,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_temporary/1/task_1423785972183_0002_r_000000/part-00000	dst=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/part-00000	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:00,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:00,065 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-866148761_1
2015-02-12 16:07:00,067 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:00,071 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-866148761_1
2015-02-12 16:07:00,096 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60732, dest: /127.0.0.1:60521, bytes: 68424, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-866148761_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741841_1017, duration: 7442040000
2015-02-12 16:07:00,096 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741841_1017, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:00,097 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]} size 16338
2015-02-12 16:07:00,097 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60731, dest: /127.0.0.1:60515, bytes: 68424, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-866148761_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741841_1017, duration: 7441915000
2015-02-12 16:07:00,098 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:00,098 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]} size 16338
2015-02-12 16:07:00,099 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60730, dest: /127.0.0.1:60518, bytes: 68424, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-866148761_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741841_1017, duration: 7445103000
2015-02-12 16:07:00,099 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:00,100 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]} size 16338
2015-02-12 16:07:00,107 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job_1423785972183_0002_1.jhist is closed by DFSClient_NONMAPREDUCE_-866148761_1
2015-02-12 16:07:00,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:00,115 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002.summary_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]}
2015-02-12 16:07:00,117 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741844_1020 src: /127.0.0.1:60768 dest: /127.0.0.1:60518
2015-02-12 16:07:00,120 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741844_1020 src: /127.0.0.1:60769 dest: /127.0.0.1:60511
2015-02-12 16:07:00,123 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741844_1020 src: /127.0.0.1:60770 dest: /127.0.0.1:60515
2015-02-12 16:07:00,129 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60770, dest: /127.0.0.1:60515, bytes: 427, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-866148761_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741844_1020, duration: 2407000
2015-02-12 16:07:00,129 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741844_1020, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:00,132 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60769, dest: /127.0.0.1:60511, bytes: 427, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-866148761_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741844_1020, duration: 5434000
2015-02-12 16:07:00,132 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741844_1020, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:00,133 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]} size 0
2015-02-12 16:07:00,134 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60768, dest: /127.0.0.1:60518, bytes: 427, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-866148761_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741844_1020, duration: 7768000
2015-02-12 16:07:00,134 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741844_1020, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:00,135 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]} size 0
2015-02-12 16:07:00,135 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:00,137 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002.summary_tmp is closed by DFSClient_NONMAPREDUCE_-866148761_1
2015-02-12 16:07:00,143 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:00,149 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job_1423785972183_0002_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2FF23EF9287BD445D4-1423786020073-5-1-SUCCEEDED-root.soberoi-1423785986823.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job_1423785972183_0002_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2FF23EF9287BD445D4-1423786020073-5-1-SUCCEEDED-root.soberoi-1423785986823.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,158 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job_1423785972183_0002_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,162 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2FF23EF9287BD445D4-1423786020073-5-1-SUCCEEDED-root.soberoi-1423785986823.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:00,167 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2FF23EF9287BD445D4-1423786020073-5-1-SUCCEEDED-root.soberoi-1423785986823.jhist_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]}
2015-02-12 16:07:00,171 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741845_1021 src: /127.0.0.1:60772 dest: /127.0.0.1:60511
2015-02-12 16:07:00,173 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741845_1021 src: /127.0.0.1:60773 dest: /127.0.0.1:60518
2015-02-12 16:07:00,174 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741845_1021 src: /127.0.0.1:60774 dest: /127.0.0.1:60515
2015-02-12 16:07:00,180 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60774, dest: /127.0.0.1:60515, bytes: 68424, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-866148761_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741845_1021, duration: 2406000
2015-02-12 16:07:00,180 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741845_1021, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:00,181 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:00,181 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60773, dest: /127.0.0.1:60518, bytes: 68424, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-866148761_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741845_1021, duration: 4535000
2015-02-12 16:07:00,182 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741845_1021, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:00,182 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:00,183 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60772, dest: /127.0.0.1:60511, bytes: 68424, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-866148761_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741845_1021, duration: 6280000
2015-02-12 16:07:00,183 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741845_1021, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:00,183 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:00,186 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2FF23EF9287BD445D4-1423786020073-5-1-SUCCEEDED-root.soberoi-1423785986823.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-866148761_1
2015-02-12 16:07:00,191 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2FF23EF9287BD445D4-1423786020073-5-1-SUCCEEDED-root.soberoi-1423785986823.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:00,193 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job_1423785972183_0002_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,197 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job_1423785972183_0002_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,201 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002/job_1423785972183_0002_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:00,211 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002_conf.xml_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]}
2015-02-12 16:07:00,214 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741846_1022 src: /127.0.0.1:60776 dest: /127.0.0.1:60518
2015-02-12 16:07:00,216 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741846_1022 src: /127.0.0.1:60777 dest: /127.0.0.1:60511
2015-02-12 16:07:00,217 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741846_1022 src: /127.0.0.1:60778 dest: /127.0.0.1:60521
2015-02-12 16:07:00,221 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60778, dest: /127.0.0.1:60521, bytes: 113231, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-866148761_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741846_1022, duration: 2233000
2015-02-12 16:07:00,221 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741846_1022, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:00,221 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]} size 0
2015-02-12 16:07:00,222 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60777, dest: /127.0.0.1:60511, bytes: 113231, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-866148761_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741846_1022, duration: 2769000
2015-02-12 16:07:00,222 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741846_1022, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:00,222 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:00,223 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60776, dest: /127.0.0.1:60518, bytes: 113231, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-866148761_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741846_1022, duration: 3868000
2015-02-12 16:07:00,223 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741846_1022, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:00,223 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:00,225 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-866148761_1
2015-02-12 16:07:00,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:00,230 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:00,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:00,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2FF23EF9287BD445D4-1423786020073-5-1-SUCCEEDED-root.soberoi-1423785986823.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2FF23EF9287BD445D4-1423786020073-5-1-SUCCEEDED-root.soberoi-1423785986823.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:00,249 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423785972183_0002_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 16:07:00,250 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0002_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 16:07:00,250 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423785972183_0002 with final state: FINISHING
2015-02-12 16:07:00,251 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0002 State change from RUNNING to FINAL_SAVING
2015-02-12 16:07:00,252 INFO  recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423785972183_0002
2015-02-12 16:07:00,252 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0002_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 16:07:00,253 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0002 State change from FINAL_SAVING to FINISHING
2015-02-12 16:07:00,436 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 16:07:00,441 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 16:07:00,452 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 16:07:00,462 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 16:07:00,464 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 16:07:00,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_temporary/1/_temporary/attempt_1423785972183_0001_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:00,762 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_temporary/1/_temporary/attempt_1423785972183_0001_r_000000_0/part-00000. BP-2102022600-10.1.1.67-1423785955551 blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]}
2015-02-12 16:07:00,876 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741847_1023 src: /127.0.0.1:60785 dest: /127.0.0.1:60521
2015-02-12 16:07:00,877 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741847_1023 src: /127.0.0.1:60786 dest: /127.0.0.1:60511
2015-02-12 16:07:00,879 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741847_1023 src: /127.0.0.1:60787 dest: /127.0.0.1:60515
2015-02-12 16:07:00,923 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60787, dest: /127.0.0.1:60515, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1423785972183_0001_r_000000_0_-1820854369_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741847_1023, duration: 42311000
2015-02-12 16:07:00,923 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741847_1023, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:00,924 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60786, dest: /127.0.0.1:60511, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1423785972183_0001_r_000000_0_-1820854369_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741847_1023, duration: 43617000
2015-02-12 16:07:00,925 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741847_1023, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:00,924 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]} size 0
2015-02-12 16:07:00,925 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:00,926 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60785, dest: /127.0.0.1:60521, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1423785972183_0001_r_000000_0_-1820854369_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741847_1023, duration: 45079000
2015-02-12 16:07:00,926 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741847_1023, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:00,928 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:00,939 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_temporary/1/_temporary/attempt_1423785972183_0001_r_000000_0/part-00000 is closed by DFSClient_attempt_1423785972183_0001_r_000000_0_-1820854369_1
2015-02-12 16:07:00,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_temporary/1/_temporary/attempt_1423785972183_0001_r_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,972 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_temporary/1/_temporary/attempt_1423785972183_0001_r_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_temporary/1/task_1423785972183_0001_r_000000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:00,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_temporary/1/_temporary/attempt_1423785972183_0001_r_000000_0	dst=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_temporary/1/task_1423785972183_0001_r_000000	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 16:07:00,985 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:07:00,985 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0002_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 16:07:00,985 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000008
2015-02-12 16:07:00,985 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0002_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 16:07:00,985 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0002_000001 released container container_1423785972183_0002_01_000008 on node: host: 10.1.1.67:60556 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 16:07:00,995 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0001_000001 (auth:SIMPLE)
2015-02-12 16:07:00,998 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0001_01_000011
2015-02-12 16:07:00,998 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000011
2015-02-12 16:07:00,998 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000011 transitioned from RUNNING to KILLING
2015-02-12 16:07:00,999 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0001_01_000011
2015-02-12 16:07:01,000 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:01,007 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:01,012 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1199307483_1
2015-02-12 16:07:01,018 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_temporary/1	dst=null	perm=null	proto=rpc
2015-02-12 16:07:01,023 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0001_01_000011 is : 143
2015-02-12 16:07:01,026 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6	dst=null	perm=null	proto=rpc
2015-02-12 16:07:01,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6	dst=null	perm=null	proto=rpc
2015-02-12 16:07:01,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_temporary/1/task_1423785972183_0001_r_000000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:01,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:01,036 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000011 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:07:01,037 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000011
2015-02-12 16:07:01,037 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000011
2015-02-12 16:07:01,037 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000011
2015-02-12 16:07:01,038 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000011
2015-02-12 16:07:01,041 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_temporary/1/task_1423785972183_0001_r_000000/part-00000	dst=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/part-00000	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:01,046 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000011
2015-02-12 16:07:01,046 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000011 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:07:01,047 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0001_01_000011 from application application_1423785972183_0001
2015-02-12 16:07:01,047 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:01,047 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0001
2015-02-12 16:07:01,048 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 16:07:01,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:01,055 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1199307483_1
2015-02-12 16:07:01,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:01,062 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1199307483_1
2015-02-12 16:07:01,083 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60738, dest: /127.0.0.1:60521, bytes: 68441, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1199307483_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741842_1018, duration: 8248422000
2015-02-12 16:07:01,084 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741842_1018, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:01,085 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 15998
2015-02-12 16:07:01,086 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60737, dest: /127.0.0.1:60515, bytes: 68441, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1199307483_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741842_1018, duration: 8250338000
2015-02-12 16:07:01,086 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741842_1018, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:01,087 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60736, dest: /127.0.0.1:60511, bytes: 68441, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1199307483_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741842_1018, duration: 8253113000
2015-02-12 16:07:01,088 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741842_1018, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:01,089 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 15998
2015-02-12 16:07:01,089 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 15998
2015-02-12 16:07:01,090 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job_1423785972183_0001_1.jhist is closed by DFSClient_NONMAPREDUCE_-1199307483_1
2015-02-12 16:07:01,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:01,097 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001.summary_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:07:01,100 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741848_1024 src: /127.0.0.1:60789 dest: /127.0.0.1:60515
2015-02-12 16:07:01,101 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741848_1024 src: /127.0.0.1:60790 dest: /127.0.0.1:60518
2015-02-12 16:07:01,103 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741848_1024 src: /127.0.0.1:60791 dest: /127.0.0.1:60511
2015-02-12 16:07:01,106 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60791, dest: /127.0.0.1:60511, bytes: 427, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1199307483_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741848_1024, duration: 1484000
2015-02-12 16:07:01,106 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741848_1024, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:01,107 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:01,107 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60790, dest: /127.0.0.1:60518, bytes: 427, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1199307483_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741848_1024, duration: 2279000
2015-02-12 16:07:01,107 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741848_1024, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:01,108 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:01,108 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60789, dest: /127.0.0.1:60515, bytes: 427, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1199307483_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741848_1024, duration: 3482000
2015-02-12 16:07:01,109 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741848_1024, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:01,109 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:01,110 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1199307483_1
2015-02-12 16:07:01,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:01,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job_1423785972183_0001_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:07:01,122 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2F4439D5D678CE4AF1-1423786021064-5-1-SUCCEEDED-root.soberoi-1423785986588.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:07:01,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job_1423785972183_0001_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:07:01,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2F4439D5D678CE4AF1-1423786021064-5-1-SUCCEEDED-root.soberoi-1423785986588.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:07:01,129 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job_1423785972183_0001_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:07:01,133 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2F4439D5D678CE4AF1-1423786021064-5-1-SUCCEEDED-root.soberoi-1423785986588.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:01,140 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2F4439D5D678CE4AF1-1423786021064-5-1-SUCCEEDED-root.soberoi-1423785986588.jhist_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]}
2015-02-12 16:07:01,144 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741849_1025 src: /127.0.0.1:60793 dest: /127.0.0.1:60515
2015-02-12 16:07:01,146 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741849_1025 src: /127.0.0.1:60794 dest: /127.0.0.1:60511
2015-02-12 16:07:01,148 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741849_1025 src: /127.0.0.1:60795 dest: /127.0.0.1:60518
2015-02-12 16:07:01,153 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60795, dest: /127.0.0.1:60518, bytes: 68441, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1199307483_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741849_1025, duration: 2067000
2015-02-12 16:07:01,154 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741849_1025, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:01,154 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]} size 0
2015-02-12 16:07:01,154 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60794, dest: /127.0.0.1:60511, bytes: 68441, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1199307483_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741849_1025, duration: 2808000
2015-02-12 16:07:01,155 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741849_1025, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:01,155 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]} size 0
2015-02-12 16:07:01,156 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60793, dest: /127.0.0.1:60515, bytes: 68441, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1199307483_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741849_1025, duration: 4062000
2015-02-12 16:07:01,156 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741849_1025, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:01,156 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]} size 0
2015-02-12 16:07:01,159 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2F4439D5D678CE4AF1-1423786021064-5-1-SUCCEEDED-root.soberoi-1423785986588.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1199307483_1
2015-02-12 16:07:01,160 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2F4439D5D678CE4AF1-1423786021064-5-1-SUCCEEDED-root.soberoi-1423785986588.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:01,162 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job_1423785972183_0001_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:01,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:07:01,166 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job_1423785972183_0001_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:01,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:07:01,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001/job_1423785972183_0001_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:01,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:01,179 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001_conf.xml_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:07:01,182 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741850_1026 src: /127.0.0.1:60797 dest: /127.0.0.1:60521
2015-02-12 16:07:01,183 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741850_1026 src: /127.0.0.1:60798 dest: /127.0.0.1:60518
2015-02-12 16:07:01,185 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741850_1026 src: /127.0.0.1:60799 dest: /127.0.0.1:60511
2015-02-12 16:07:01,192 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60799, dest: /127.0.0.1:60511, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1199307483_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741850_1026, duration: 4021000
2015-02-12 16:07:01,192 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741850_1026, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:01,193 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60798, dest: /127.0.0.1:60518, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1199307483_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741850_1026, duration: 3515000
2015-02-12 16:07:01,193 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741850_1026, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:01,194 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:01,194 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60797, dest: /127.0.0.1:60521, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1199307483_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741850_1026, duration: 5854000
2015-02-12 16:07:01,195 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:01,195 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741850_1026, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:01,196 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:01,198 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1199307483_1
2015-02-12 16:07:01,202 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:01,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:01,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:01,214 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2F4439D5D678CE4AF1-1423786021064-5-1-SUCCEEDED-root.soberoi-1423785986588.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2F4439D5D678CE4AF1-1423786021064-5-1-SUCCEEDED-root.soberoi-1423785986588.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:01,222 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423785972183_0001_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 16:07:01,222 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0001_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 16:07:01,222 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423785972183_0001 with final state: FINISHING
2015-02-12 16:07:01,223 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0001 State change from RUNNING to FINAL_SAVING
2015-02-12 16:07:01,223 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0001_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 16:07:01,223 INFO  recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423785972183_0001
2015-02-12 16:07:01,223 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0001 State change from FINAL_SAVING to FINISHING
2015-02-12 16:07:01,263 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423785972183_0002 unregistered successfully. 
2015-02-12 16:07:01,267 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741830_1006 127.0.0.1:60518 127.0.0.1:60521 127.0.0.1:60515 127.0.0.1:60511 
2015-02-12 16:07:01,268 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741831_1007 127.0.0.1:60515 127.0.0.1:60518 127.0.0.1:60511 127.0.0.1:60521 
2015-02-12 16:07:01,268 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741834_1010 127.0.0.1:60511 127.0.0.1:60518 127.0.0.1:60515 
2015-02-12 16:07:01,268 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741836_1012 127.0.0.1:60518 127.0.0.1:60511 127.0.0.1:60515 
2015-02-12 16:07:01,268 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741840_1016 127.0.0.1:60511 127.0.0.1:60521 127.0.0.1:60515 
2015-02-12 16:07:01,268 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741841_1017 127.0.0.1:60518 127.0.0.1:60515 127.0.0.1:60521 
2015-02-12 16:07:01,269 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741839_1015 127.0.0.1:60515 127.0.0.1:60511 127.0.0.1:60521 
2015-02-12 16:07:01,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0002	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,005 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000011 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:07:02,005 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0001_01_000011 in state: COMPLETED event:FINISHED
2015-02-12 16:07:02,005 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000011
2015-02-12 16:07:02,006 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0001_01_000011 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 16:07:02,006 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0001_000001 released container container_1423785972183_0001_01_000011 on node: host: 10.1.1.67:60556 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 16:07:02,006 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:02,233 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423785972183_0001 unregistered successfully. 
2015-02-12 16:07:02,237 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741829_1005 127.0.0.1:60518 127.0.0.1:60511 127.0.0.1:60515 127.0.0.1:60521 
2015-02-12 16:07:02,237 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741832_1008 127.0.0.1:60518 127.0.0.1:60511 127.0.0.1:60521 127.0.0.1:60515 
2015-02-12 16:07:02,237 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741833_1009 127.0.0.1:60518 127.0.0.1:60511 127.0.0.1:60515 
2015-02-12 16:07:02,237 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741835_1011 127.0.0.1:60511 127.0.0.1:60521 127.0.0.1:60518 
2015-02-12 16:07:02,238 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741838_1014 127.0.0.1:60518 127.0.0.1:60515 127.0.0.1:60521 
2015-02-12 16:07:02,238 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741842_1018 127.0.0.1:60511 127.0.0.1:60515 127.0.0.1:60521 
2015-02-12 16:07:02,238 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741837_1013 127.0.0.1:60518 127.0.0.1:60515 127.0.0.1:60511 
2015-02-12 16:07:02,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0001	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,284 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (3/3) ...latform/COMPLETED/stopped
2015-02-12 16:07:02,302 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:60553
2015-02-12 16:07:02,328 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:60553
2015-02-12 16:07:02,333 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,340 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 3
2015-02-12 16:07:02,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 16:07:02,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 16:07:02,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,348 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:02,351 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar. BP-2102022600-10.1.1.67-1423785955551 blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]}
2015-02-12 16:07:02,354 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741851_1027 src: /127.0.0.1:60802 dest: /127.0.0.1:60518
2015-02-12 16:07:02,357 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741851_1027 src: /127.0.0.1:60803 dest: /127.0.0.1:60511
2015-02-12 16:07:02,359 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741851_1027 src: /127.0.0.1:60804 dest: /127.0.0.1:60515
2015-02-12 16:07:02,367 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60804, dest: /127.0.0.1:60515, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741851_1027, duration: 5574000
2015-02-12 16:07:02,367 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741851_1027, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:02,368 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:02,368 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60803, dest: /127.0.0.1:60511, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741851_1027, duration: 6240000
2015-02-12 16:07:02,369 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741851_1027, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:02,369 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:02,370 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60802, dest: /127.0.0.1:60518, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741851_1027, duration: 8115000
2015-02-12 16:07:02,370 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741851_1027, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:02,375 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:02,379 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:07:02,380 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar
2015-02-12 16:07:02,381 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:02,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,385 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,401 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 16:07:02,402 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,406 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,407 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 16:07:02,409 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,414 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 16:07:02,416 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,421 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 16:07:02,424 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:02,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:02,429 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.split
2015-02-12 16:07:02,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,431 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.split. BP-2102022600-10.1.1.67-1423785955551 blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:07:02,433 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741852_1028 src: /127.0.0.1:60805 dest: /127.0.0.1:60521
2015-02-12 16:07:02,435 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741852_1028 src: /127.0.0.1:60806 dest: /127.0.0.1:60518
2015-02-12 16:07:02,437 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741852_1028 src: /127.0.0.1:60807 dest: /127.0.0.1:60515
2015-02-12 16:07:02,439 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741852_1028 src: /127.0.0.1:60808 dest: /127.0.0.1:60511
2015-02-12 16:07:02,442 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60808, dest: /127.0.0.1:60511, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741852_1028, duration: 1733000
2015-02-12 16:07:02,442 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741852_1028, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:02,442 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:02,443 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60807, dest: /127.0.0.1:60515, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741852_1028, duration: 2345000
2015-02-12 16:07:02,443 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741852_1028, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:02,444 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60806, dest: /127.0.0.1:60518, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741852_1028, duration: 3764000
2015-02-12 16:07:02,444 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741852_1028, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:02,445 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:02,446 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60805, dest: /127.0.0.1:60521, bytes: 697, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741852_1028, duration: 5227000
2015-02-12 16:07:02,446 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741852_1028, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:02,447 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:02,450 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:02,453 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.split is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:07:02,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:02,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:02,463 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.splitmetainfo. BP-2102022600-10.1.1.67-1423785955551 blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]}
2015-02-12 16:07:02,465 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741853_1029 src: /127.0.0.1:60809 dest: /127.0.0.1:60511
2015-02-12 16:07:02,466 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741853_1029 src: /127.0.0.1:60810 dest: /127.0.0.1:60521
2015-02-12 16:07:02,468 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741853_1029 src: /127.0.0.1:60811 dest: /127.0.0.1:60515
2015-02-12 16:07:02,473 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60811, dest: /127.0.0.1:60515, bytes: 80, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741853_1029, duration: 2720000
2015-02-12 16:07:02,473 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741853_1029, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:02,474 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]} size 0
2015-02-12 16:07:02,474 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60810, dest: /127.0.0.1:60521, bytes: 80, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741853_1029, duration: 4135000
2015-02-12 16:07:02,474 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741853_1029, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:02,475 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]} size 0
2015-02-12 16:07:02,475 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60809, dest: /127.0.0.1:60511, bytes: 80, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741853_1029, duration: 5623000
2015-02-12 16:07:02,476 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741853_1029, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:02,478 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]} size 0
2015-02-12 16:07:02,481 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:07:02,482 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:2
2015-02-12 16:07:02,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:02,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:02,552 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.xml. BP-2102022600-10.1.1.67-1423785955551 blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]}
2015-02-12 16:07:02,555 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741854_1030 src: /127.0.0.1:60812 dest: /127.0.0.1:60518
2015-02-12 16:07:02,556 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741854_1030 src: /127.0.0.1:60813 dest: /127.0.0.1:60511
2015-02-12 16:07:02,558 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741854_1030 src: /127.0.0.1:60814 dest: /127.0.0.1:60521
2015-02-12 16:07:02,572 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60814, dest: /127.0.0.1:60521, bytes: 97514, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741854_1030, duration: 11529000
2015-02-12 16:07:02,572 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741854_1030, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:02,572 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]} size 0
2015-02-12 16:07:02,573 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60813, dest: /127.0.0.1:60511, bytes: 97514, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741854_1030, duration: 11497000
2015-02-12 16:07:02,573 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741854_1030, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:02,574 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:02,574 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60812, dest: /127.0.0.1:60518, bytes: 97514, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741854_1030, duration: 12646000
2015-02-12 16:07:02,574 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741854_1030, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:02,577 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:02,581 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.xml is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:07:02,582 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423785972183_0003
2015-02-12 16:07:02,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,587 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,607 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,628 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,630 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:02,632 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 3 submitted by user soberoi
2015-02-12 16:07:02,632 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423785972183_0003
2015-02-12 16:07:02,632 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi	IP=10.1.1.67	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423785972183_0003
2015-02-12 16:07:02,633 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423785972183_0003
2015-02-12 16:07:02,633 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0003 State change from NEW to NEW_SAVING
2015-02-12 16:07:02,633 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0003 State change from NEW_SAVING to SUBMITTED
2015-02-12 16:07:02,633 INFO  fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423785972183_0003 from user: soberoi, in queue: default, currently num of applications: 3
2015-02-12 16:07:02,634 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0003 State change from SUBMITTED to ACCEPTED
2015-02-12 16:07:02,634 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423785972183_0003_000001
2015-02-12 16:07:02,634 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0003_000001 State change from NEW to SUBMITTED
2015-02-12 16:07:02,635 INFO  fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423785972183_0003_000001 to scheduler from user: soberoi
2015-02-12 16:07:02,636 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0003_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 16:07:02,636 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423785972183_0003
2015-02-12 16:07:02,640 INFO  mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:60554/proxy/application_1423785972183_0003/
2015-02-12 16:07:02,640 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423785972183_0003
2015-02-12 16:07:02,640 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60554/proxy/application_1423785972183_0003/
2015-02-12 16:07:02,694 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0003_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:02,695 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000001
2015-02-12 16:07:02,695 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0003_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:60564, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 16:07:02,695 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60564 for container : container_1423785972183_0003_01_000001
2015-02-12 16:07:02,696 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0003_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:07:02,696 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423785972183_0003_000001
2015-02-12 16:07:02,696 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423785972183_0003 AttemptId: appattempt_1423785972183_0003_000001 MasterContainer: Container: [ContainerId: container_1423785972183_0003_01_000001, NodeId: 10.1.1.67:60564, NodeHttpAddress: 10.1.1.67:60567, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60564 }, ]
2015-02-12 16:07:02,696 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0003_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 16:07:02,696 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0003_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 16:07:02,697 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423785972183_0003_000001
2015-02-12 16:07:02,698 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423785972183_0003_01_000001, NodeId: 10.1.1.67:60564, NodeHttpAddress: 10.1.1.67:60567, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60564 }, ] for AM appattempt_1423785972183_0003_000001
2015-02-12 16:07:02,699 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423785972183_0003_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 16:07:02,699 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423785972183_0003_000001
2015-02-12 16:07:02,699 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423785972183_0003_000001
2015-02-12 16:07:02,700 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:60518 to replicate blk_1073741851_1027 to datanode(s) 127.0.0.1:60521
2015-02-12 16:07:02,701 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60511 to delete [blk_1073741840_1016, blk_1073741842_1018, blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741832_1008, blk_1073741833_1009, blk_1073741834_1010, blk_1073741835_1011, blk_1073741836_1012, blk_1073741837_1013, blk_1073741839_1015]
2015-02-12 16:07:02,701 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60518 to delete [blk_1073741841_1017, blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741832_1008, blk_1073741833_1009, blk_1073741834_1010, blk_1073741835_1011, blk_1073741836_1012, blk_1073741837_1013, blk_1073741838_1014]
2015-02-12 16:07:02,702 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0003_000001 (auth:SIMPLE)
2015-02-12 16:07:02,705 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0003_01_000001 by user soberoi
2015-02-12 16:07:02,705 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0003
2015-02-12 16:07:02,705 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000001
2015-02-12 16:07:02,705 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0003 transitioned from NEW to INITING
2015-02-12 16:07:02,705 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0003_01_000001 to application application_1423785972183_0003
2015-02-12 16:07:02,706 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423785972183_0003_01_000001, NodeId: 10.1.1.67:60564, NodeHttpAddress: 10.1.1.67:60567, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60564 }, ] for AM appattempt_1423785972183_0003_000001
2015-02-12 16:07:02,706 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0003 transitioned from INITING to RUNNING
2015-02-12 16:07:02,706 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0003_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 16:07:02,706 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 16:07:02,706 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0003
2015-02-12 16:07:02,707 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:07:02,707 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 16:07:02,707 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.split transitioned from INIT to DOWNLOADING
2015-02-12 16:07:02,707 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:07:02,707 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0003_01_000001
2015-02-12 16:07:02,722 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423785972183_0003_01_000001.tokens. Credentials list: 
2015-02-12 16:07:02,870 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:07:02,989 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423785972183_0003_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000001.tokens
2015-02-12 16:07:02,991 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0003
2015-02-12 16:07:03,006 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:03,006 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:03,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:03,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:03,166 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0003/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:03,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:07:03,196 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:07:03,240 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0003/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:03,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:03,268 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:03,303 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0003/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:03,328 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:03,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:03,369 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0003/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:03,369 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:07:03,413 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 16:07:03,413 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:03,525 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000001/default_container_executor.sh]
2015-02-12 16:07:03,589 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741840 for deletion
2015-02-12 16:07:03,590 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741842 for deletion
2015-02-12 16:07:03,591 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741840
2015-02-12 16:07:03,591 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741829 for deletion
2015-02-12 16:07:03,591 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741830 for deletion
2015-02-12 16:07:03,591 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741831 for deletion
2015-02-12 16:07:03,591 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741832 for deletion
2015-02-12 16:07:03,591 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741833 for deletion
2015-02-12 16:07:03,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741834 for deletion
2015-02-12 16:07:03,591 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741842
2015-02-12 16:07:03,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741829
2015-02-12 16:07:03,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741830
2015-02-12 16:07:03,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741832
2015-02-12 16:07:03,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741835 for deletion
2015-02-12 16:07:03,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741836 for deletion
2015-02-12 16:07:03,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741837 for deletion
2015-02-12 16:07:03,594 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741839_1015 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741839 for deletion
2015-02-12 16:07:03,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741831
2015-02-12 16:07:03,594 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741834
2015-02-12 16:07:03,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741833
2015-02-12 16:07:03,595 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741835
2015-02-12 16:07:03,595 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741839_1015 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741839
2015-02-12 16:07:03,594 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741836
2015-02-12 16:07:03,596 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741837
2015-02-12 16:07:03,701 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0003_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:07:03,955 INFO  datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=1309dd03-96de-4536-9ff7-96af7fbd7a36, infoPort=60519, ipcPort=60520, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0) Starting thread to transfer BP-2102022600-10.1.1.67-1423785955551:blk_1073741851_1027 to 127.0.0.1:60521 
2015-02-12 16:07:03,955 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741841 for deletion
2015-02-12 16:07:03,956 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741829 for deletion
2015-02-12 16:07:03,956 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741830 for deletion
2015-02-12 16:07:03,956 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741841
2015-02-12 16:07:03,956 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741851_1027 src: /127.0.0.1:60820 dest: /127.0.0.1:60521
2015-02-12 16:07:03,957 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741829
2015-02-12 16:07:03,957 INFO  datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-2102022600-10.1.1.67-1423785955551:blk_1073741851_1027 (numBytes=254067) to /127.0.0.1:60521
2015-02-12 16:07:03,957 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741830
2015-02-12 16:07:03,957 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741831 for deletion
2015-02-12 16:07:03,958 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741832 for deletion
2015-02-12 16:07:03,958 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741833 for deletion
2015-02-12 16:07:03,958 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741831
2015-02-12 16:07:03,958 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741834 for deletion
2015-02-12 16:07:03,958 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741835 for deletion
2015-02-12 16:07:03,958 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741832
2015-02-12 16:07:03,958 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741836 for deletion
2015-02-12 16:07:03,958 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741837 for deletion
2015-02-12 16:07:03,959 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741834
2015-02-12 16:07:03,959 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741835
2015-02-12 16:07:03,959 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741837
2015-02-12 16:07:03,958 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741833
2015-02-12 16:07:03,960 INFO  datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-2102022600-10.1.1.67-1423785955551:blk_1073741851_1027 src: /127.0.0.1:60820 dest: /127.0.0.1:60521 of size 254067
2015-02-12 16:07:03,960 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741836
2015-02-12 16:07:03,959 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741838 for deletion
2015-02-12 16:07:03,961 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741838
2015-02-12 16:07:03,961 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741851_1027 size 254067
2015-02-12 16:07:04,013 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:04,013 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:05,019 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:05,019 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:05,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:07:05,512 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 16:07:05,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 16:07:05,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 16:07:05,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003	dst=null	perm=null	proto=rpc
2015-02-12 16:07:05,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 16:07:05,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:07:05,708 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60515 to delete [blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741832_1008, blk_1073741833_1009, blk_1073741834_1010, blk_1073741836_1012, blk_1073741837_1013, blk_1073741838_1014, blk_1073741839_1015, blk_1073741840_1016, blk_1073741841_1017, blk_1073741842_1018]
2015-02-12 16:07:05,709 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60521 to delete [blk_1073741840_1016, blk_1073741841_1017, blk_1073741842_1018, blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741832_1008, blk_1073741835_1011, blk_1073741838_1014, blk_1073741839_1015]
2015-02-12 16:07:05,930 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:07:05,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:07:06,022 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:06,023 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:06,327 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423785972183_0002_01_000001 succeeded 
2015-02-12 16:07:06,328 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 16:07:06,328 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0002_01_000001
2015-02-12 16:07:06,345 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000001
2015-02-12 16:07:06,345 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000001
2015-02-12 16:07:06,346 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000001
2015-02-12 16:07:06,347 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0002_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 16:07:06,347 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0002_01_000001 from application application_1423785972183_0002
2015-02-12 16:07:06,347 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:06,347 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0002
2015-02-12 16:07:06,346 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000001
2015-02-12 16:07:06,347 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0002/container_1423785972183_0002_01_000001
2015-02-12 16:07:06,510 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0002_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:07:06,510 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0002_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 16:07:06,510 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000001
2015-02-12 16:07:06,510 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0002_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:60568, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 16:07:06,511 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0002_000001 released container container_1423785972183_0002_01_000001 on node: host: 10.1.1.67:60568 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 16:07:06,510 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423785972183_0002_000001
2015-02-12 16:07:06,512 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423785972183_0002_000001
2015-02-12 16:07:06,512 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0002_000001 State change from FINISHING to FINISHED
2015-02-12 16:07:06,514 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0002 State change from FINISHING to FINISHED
2015-02-12 16:07:06,514 INFO  fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423785972183_0002_000001 is done. finalState=FINISHED
2015-02-12 16:07:06,515 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423785972183_0002 requests cleared
2015-02-12 16:07:06,515 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1423785972183_0002
2015-02-12 16:07:06,516 INFO  amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423785972183_0002_000001
2015-02-12 16:07:06,517 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423785972183_0002,name=[ED5761C72550422D816BADF9668975E8/F23EF9287BD445D4B455F6F5C86EF1B6] lower*upper/(2/3),user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:60554/proxy/application_1423785972183_0002/jobhistory/job/job_1423785972183_0002,appMasterHost=10.1.1.67,startTime=1423785978932,finishTime=1423786020250,finalStatus=SUCCEEDED
2015-02-12 16:07:06,520 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0002_000001 (auth:SIMPLE)
2015-02-12 16:07:06,522 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0002_01_000001
2015-02-12 16:07:06,522 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0002	CONTAINERID=container_1423785972183_0002_01_000001
2015-02-12 16:07:06,523 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0002_01_000001]
2015-02-12 16:07:06,523 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:06,524 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:07:06,524 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:07:06,525 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:07:06,525 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0002
2015-02-12 16:07:06,525 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:07:06,526 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:07:06,526 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0002, with delay of 10800 seconds
2015-02-12 16:07:06,527 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:07:06,591 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741829 for deletion
2015-02-12 16:07:06,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741830 for deletion
2015-02-12 16:07:06,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741831 for deletion
2015-02-12 16:07:06,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741829
2015-02-12 16:07:06,594 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741830
2015-02-12 16:07:06,594 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741831
2015-02-12 16:07:06,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741832 for deletion
2015-02-12 16:07:06,595 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741833 for deletion
2015-02-12 16:07:06,596 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741834 for deletion
2015-02-12 16:07:06,596 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741836 for deletion
2015-02-12 16:07:06,596 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741832
2015-02-12 16:07:06,597 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741834
2015-02-12 16:07:06,597 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741833
2015-02-12 16:07:06,597 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741836
2015-02-12 16:07:06,596 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741837 for deletion
2015-02-12 16:07:06,597 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741838 for deletion
2015-02-12 16:07:06,598 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741839_1015 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741839 for deletion
2015-02-12 16:07:06,598 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741840 for deletion
2015-02-12 16:07:06,598 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741841 for deletion
2015-02-12 16:07:06,598 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741838
2015-02-12 16:07:06,598 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741837
2015-02-12 16:07:06,598 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741840
2015-02-12 16:07:06,599 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741839_1015 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741839
2015-02-12 16:07:06,599 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741841
2015-02-12 16:07:06,598 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741842 for deletion
2015-02-12 16:07:06,600 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741842
2015-02-12 16:07:06,716 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:07:06,717 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:07:06,717 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:07:06,718 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:07:06,718 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:07:06,718 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0002
2015-02-12 16:07:06,718 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:07:06,718 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0002, with delay of 10800 seconds
2015-02-12 16:07:06,819 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:07:06,819 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:07:06,819 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:07:06,820 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:07:06,820 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0002
2015-02-12 16:07:06,820 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:07:06,821 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0002, with delay of 10800 seconds
2015-02-12 16:07:06,821 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:07:07,026 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:07,026 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:07,026 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:07:07,027 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:07:07,027 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:07:07,027 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0002
2015-02-12 16:07:07,028 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:07:07,028 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0002, with delay of 10800 seconds
2015-02-12 16:07:07,028 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:07:07,028 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0002
2015-02-12 16:07:07,049 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0003_000001 (auth:SIMPLE)
2015-02-12 16:07:07,051 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423785972183_0003_000001
2015-02-12 16:07:07,052 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi	IP=10.1.1.67	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423785972183_0003	APPATTEMPTID=appattempt_1423785972183_0003_000001
2015-02-12 16:07:07,052 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0003_000001 State change from LAUNCHED to RUNNING
2015-02-12 16:07:07,052 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0003 State change from ACCEPTED to RUNNING
2015-02-12 16:07:07,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job_1423785972183_0003_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:07,133 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 16:07:07,230 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job_1423785972183_0003_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:07,245 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741840 for deletion
2015-02-12 16:07:07,246 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741841 for deletion
2015-02-12 16:07:07,246 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741842 for deletion
2015-02-12 16:07:07,246 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741829 for deletion
2015-02-12 16:07:07,246 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741830 for deletion
2015-02-12 16:07:07,246 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741831 for deletion
2015-02-12 16:07:07,246 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741841
2015-02-12 16:07:07,247 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741829
2015-02-12 16:07:07,246 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741840
2015-02-12 16:07:07,247 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741830
2015-02-12 16:07:07,246 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741832 for deletion
2015-02-12 16:07:07,248 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741842
2015-02-12 16:07:07,248 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741835 for deletion
2015-02-12 16:07:07,248 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741838 for deletion
2015-02-12 16:07:07,248 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741831
2015-02-12 16:07:07,248 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741832
2015-02-12 16:07:07,248 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741839_1015 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741839 for deletion
2015-02-12 16:07:07,249 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741835
2015-02-12 16:07:07,249 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741839_1015 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741839
2015-02-12 16:07:07,249 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741838
2015-02-12 16:07:07,305 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423785972183_0001_01_000001 succeeded 
2015-02-12 16:07:07,306 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 16:07:07,306 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0001_01_000001
2015-02-12 16:07:07,331 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000001
2015-02-12 16:07:07,331 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000001
2015-02-12 16:07:07,332 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000001
2015-02-12 16:07:07,332 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000001
2015-02-12 16:07:07,332 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0001_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 16:07:07,332 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0001_01_000001 from application application_1423785972183_0001
2015-02-12 16:07:07,332 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:07,332 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0001
2015-02-12 16:07:07,333 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0001/container_1423785972183_0001_01_000001
2015-02-12 16:07:07,488 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job_1423785972183_0003_1_conf.xml. BP-2102022600-10.1.1.67-1423785955551 blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]}
2015-02-12 16:07:07,511 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741844_1020
2015-02-12 16:07:07,512 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741848_1024
2015-02-12 16:07:07,513 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741850_1026
2015-02-12 16:07:07,513 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741852_1028
2015-02-12 16:07:07,514 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741847_1023
2015-02-12 16:07:07,529 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741844_1020
2015-02-12 16:07:07,529 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741843_1019
2015-02-12 16:07:07,530 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741849_1025
2015-02-12 16:07:07,530 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741848_1024
2015-02-12 16:07:07,532 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741851_1027
2015-02-12 16:07:07,534 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741852_1028
2015-02-12 16:07:07,534 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741853_1029
2015-02-12 16:07:07,534 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741847_1023
2015-02-12 16:07:07,535 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741855_1031 src: /127.0.0.1:60829 dest: /127.0.0.1:60511
2015-02-12 16:07:07,535 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741845_1021
2015-02-12 16:07:07,537 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741855_1031 src: /127.0.0.1:60830 dest: /127.0.0.1:60521
2015-02-12 16:07:07,538 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741855_1031 src: /127.0.0.1:60831 dest: /127.0.0.1:60515
2015-02-12 16:07:07,573 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60831, dest: /127.0.0.1:60515, bytes: 114229, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_311764385_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741855_1031, duration: 32194000
2015-02-12 16:07:07,573 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741855_1031, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:07,574 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:07,574 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60830, dest: /127.0.0.1:60521, bytes: 114229, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_311764385_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741855_1031, duration: 33643000
2015-02-12 16:07:07,575 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741855_1031, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:07,577 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:07,577 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60829, dest: /127.0.0.1:60511, bytes: 114229, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_311764385_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741855_1031, duration: 35353000
2015-02-12 16:07:07,577 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741855_1031, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:07,577 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:07,583 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job_1423785972183_0003_1_conf.xml is closed by DFSClient_NONMAPREDUCE_311764385_1
2015-02-12 16:07:07,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job_1423785972183_0003.summary	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:07,631 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job_1423785972183_0003.summary. BP-2102022600-10.1.1.67-1423785955551 blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]}
2015-02-12 16:07:07,633 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741856_1032 src: /127.0.0.1:60832 dest: /127.0.0.1:60515
2015-02-12 16:07:07,635 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741856_1032 src: /127.0.0.1:60833 dest: /127.0.0.1:60518
2015-02-12 16:07:07,636 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741856_1032 src: /127.0.0.1:60834 dest: /127.0.0.1:60521
2015-02-12 16:07:07,642 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60834, dest: /127.0.0.1:60521, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_311764385_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741856_1032, duration: 2552000
2015-02-12 16:07:07,642 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741856_1032, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:07,642 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:07,643 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60833, dest: /127.0.0.1:60518, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_311764385_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741856_1032, duration: 3177000
2015-02-12 16:07:07,643 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741856_1032, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:07,644 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60832, dest: /127.0.0.1:60515, bytes: 395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_311764385_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741856_1032, duration: 4622000
2015-02-12 16:07:07,644 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741856_1032, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:07,645 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:07,646 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:07,661 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job_1423785972183_0003.summary is closed by DFSClient_NONMAPREDUCE_311764385_1
2015-02-12 16:07:07,718 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741851_1027
2015-02-12 16:07:07,719 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741849_1025
2015-02-12 16:07:07,719 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741853_1029
2015-02-12 16:07:07,919 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741845_1021
2015-02-12 16:07:07,921 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741846_1022
2015-02-12 16:07:07,928 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741843_1019
2015-02-12 16:07:07,928 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741844_1020
2015-02-12 16:07:07,929 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741850_1026
2015-02-12 16:07:07,930 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741848_1024
2015-02-12 16:07:07,931 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741851_1027
2015-02-12 16:07:07,932 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741845_1021
2015-02-12 16:07:07,933 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741852_1028
2015-02-12 16:07:07,933 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741849_1025
2015-02-12 16:07:08,032 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0001_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:07:08,032 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423785972183_0001_000001
2015-02-12 16:07:08,032 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0001_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 16:07:08,033 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000001
2015-02-12 16:07:08,033 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0001_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:60556, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 16:07:08,033 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423785972183_0001_000001
2015-02-12 16:07:08,033 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0001_000001 released container container_1423785972183_0001_01_000001 on node: host: 10.1.1.67:60556 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 16:07:08,034 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:08,034 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0001_000001 State change from FINISHING to FINISHED
2015-02-12 16:07:08,034 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:08,034 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0001 State change from FINISHING to FINISHED
2015-02-12 16:07:08,035 INFO  fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423785972183_0001_000001 is done. finalState=FINISHED
2015-02-12 16:07:08,035 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423785972183_0001 requests cleared
2015-02-12 16:07:08,036 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1423785972183_0001
2015-02-12 16:07:08,036 INFO  amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423785972183_0001_000001
2015-02-12 16:07:08,036 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423785972183_0001,name=[ED5761C72550422D816BADF9668975E8/4439D5D678CE4AF182849E2F0CE0786D] lower*upper/(1/3),user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:60554/proxy/application_1423785972183_0001/jobhistory/job/job_1423785972183_0001,appMasterHost=10.1.1.67,startTime=1423785978932,finishTime=1423786021222,finalStatus=SUCCEEDED
2015-02-12 16:07:08,039 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0001_000001 (auth:SIMPLE)
2015-02-12 16:07:08,041 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0001_01_000001
2015-02-12 16:07:08,042 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0001	CONTAINERID=container_1423785972183_0001_01_000001
2015-02-12 16:07:08,042 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0001_01_000001]
2015-02-12 16:07:08,042 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:08,042 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:07:08,042 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:08,043 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:07:08,043 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:07:08,043 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:07:08,044 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0001
2015-02-12 16:07:08,044 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:07:08,044 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0001, with delay of 10800 seconds
2015-02-12 16:07:08,044 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:07:08,138 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741846_1022
2015-02-12 16:07:08,139 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741854_1030
2015-02-12 16:07:08,220 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741854_1030
2015-02-12 16:07:08,221 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741847_1023
2015-02-12 16:07:08,222 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741843_1019
2015-02-12 16:07:08,223 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741850_1026
2015-02-12 16:07:08,430 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741846_1022
2015-02-12 16:07:08,431 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741853_1029
2015-02-12 16:07:08,432 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741852_1028
2015-02-12 16:07:08,535 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:07:08,536 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0003_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:08,536 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000002
2015-02-12 16:07:08,536 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:07:08,537 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:07:08,536 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0003_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 16:07:08,537 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:07:08,537 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:07:08,537 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0001
2015-02-12 16:07:08,539 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:07:08,539 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0001, with delay of 10800 seconds
2015-02-12 16:07:08,728 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:07:08,729 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0003_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:08,729 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:07:08,729 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000003
2015-02-12 16:07:08,730 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0001
2015-02-12 16:07:08,730 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:07:08,731 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:07:08,731 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0001, with delay of 10800 seconds
2015-02-12 16:07:08,730 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0003_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 16:07:08,730 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:07:08,730 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:07:08,830 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:07:08,841 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:07:08,842 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:07:08,842 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0001
2015-02-12 16:07:08,842 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:07:08,843 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0001, with delay of 10800 seconds
2015-02-12 16:07:08,843 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:07:08,843 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0001
2015-02-12 16:07:09,048 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:09,133 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60568 for container : container_1423785972183_0003_01_000002
2015-02-12 16:07:09,134 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0003_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:07:09,134 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60564 for container : container_1423785972183_0003_01_000003
2015-02-12 16:07:09,135 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0003_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:07:09,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:09,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:09,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:09,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:09,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:09,191 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:09,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:09,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:09,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:09,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:09,276 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0003_000001 (auth:SIMPLE)
2015-02-12 16:07:09,276 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0003_000001 (auth:SIMPLE)
2015-02-12 16:07:09,279 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0003_01_000002 by user soberoi
2015-02-12 16:07:09,279 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0003_01_000003 by user soberoi
2015-02-12 16:07:09,280 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000003
2015-02-12 16:07:09,280 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0003_01_000003 to application application_1423785972183_0003
2015-02-12 16:07:09,280 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 16:07:09,280 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0003
2015-02-12 16:07:09,280 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0003
2015-02-12 16:07:09,280 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:07:09,279 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0003
2015-02-12 16:07:09,281 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0003
2015-02-12 16:07:09,281 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000002
2015-02-12 16:07:09,281 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:07:09,282 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0003 transitioned from NEW to INITING
2015-02-12 16:07:09,282 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0003_01_000002 to application application_1423785972183_0003
2015-02-12 16:07:09,282 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0003 transitioned from INITING to RUNNING
2015-02-12 16:07:09,283 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 16:07:09,283 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0003
2015-02-12 16:07:09,283 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0003
2015-02-12 16:07:09,283 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:07:09,283 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0003
2015-02-12 16:07:09,283 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:07:09,284 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:07:09,284 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0003_01_000002
2015-02-12 16:07:09,301 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423785972183_0003_01_000002.tokens. Credentials list: 
2015-02-12 16:07:09,332 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 16:07:09,333 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:09,472 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:07:09,478 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000003/default_container_executor.sh]
2015-02-12 16:07:09,537 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0003_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:07:09,599 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423785972183_0003_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000002.tokens
2015-02-12 16:07:09,599 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0003
2015-02-12 16:07:09,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:09,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:09,730 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0003_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:07:09,775 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0003/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:09,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:09,808 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:09,848 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0003/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:09,848 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:07:09,903 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 16:07:09,903 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:10,034 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000002/default_container_executor.sh]
2015-02-12 16:07:10,149 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 16:07:12,932 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741855_1031
2015-02-12 16:07:12,933 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741854_1030
2015-02-12 16:07:13,151 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741856_1032
2015-02-12 16:07:13,191 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:13,357 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:13,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:13,436 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741856_1032
2015-02-12 16:07:13,437 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741855_1031
2015-02-12 16:07:13,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:13,644 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741851_1027
2015-02-12 16:07:13,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_temporary/1/_temporary/attempt_1423785972183_0003_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 16:07:13,724 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0003_000001 (auth:SIMPLE)
2015-02-12 16:07:13,725 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0003_01_000003
2015-02-12 16:07:13,725 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000003
2015-02-12 16:07:13,725 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000003 transitioned from RUNNING to KILLING
2015-02-12 16:07:13,726 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0003_01_000003
2015-02-12 16:07:13,749 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0003_01_000003 is : 143
2015-02-12 16:07:13,751 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job_1423785972183_0003_1.jhist. BP-2102022600-10.1.1.67-1423785955551 blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]}
2015-02-12 16:07:13,757 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741857_1033 src: /127.0.0.1:60849 dest: /127.0.0.1:60521
2015-02-12 16:07:13,760 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741857_1033 src: /127.0.0.1:60850 dest: /127.0.0.1:60511
2015-02-12 16:07:13,763 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741857_1033 src: /127.0.0.1:60851 dest: /127.0.0.1:60518
2015-02-12 16:07:13,770 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job_1423785972183_0003_1.jhist for DFSClient_NONMAPREDUCE_311764385_1
2015-02-12 16:07:13,771 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:07:13,772 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000003
2015-02-12 16:07:13,773 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000003
2015-02-12 16:07:13,774 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000003
2015-02-12 16:07:13,775 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000003
2015-02-12 16:07:13,776 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000003
2015-02-12 16:07:13,776 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:07:13,776 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0003_01_000003 from application application_1423785972183_0003
2015-02-12 16:07:13,776 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:13,776 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0003
2015-02-12 16:07:13,848 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:13,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:14,085 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_temporary/1/_temporary/attempt_1423785972183_0003_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 16:07:14,096 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0003_000001 (auth:SIMPLE)
2015-02-12 16:07:14,097 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0003_01_000002
2015-02-12 16:07:14,098 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000002
2015-02-12 16:07:14,098 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000002 transitioned from RUNNING to KILLING
2015-02-12 16:07:14,098 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0003_01_000002
2015-02-12 16:07:14,117 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0003_01_000002 is : 143
2015-02-12 16:07:14,125 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:07:14,125 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000002
2015-02-12 16:07:14,125 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000002
2015-02-12 16:07:14,126 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000002
2015-02-12 16:07:14,126 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:07:14,126 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000002
2015-02-12 16:07:14,126 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000002
2015-02-12 16:07:14,126 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0003_01_000002 from application application_1423785972183_0003
2015-02-12 16:07:14,127 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:14,127 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0003
2015-02-12 16:07:14,731 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0003_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:07:14,731 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0003_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 16:07:14,731 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000003
2015-02-12 16:07:14,732 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0003_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 16:07:14,732 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0003_000001 released container container_1423785972183_0003_01_000003 on node: host: 10.1.1.67:60564 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 16:07:15,103 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0003_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:07:15,103 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0003_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 16:07:15,103 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000002
2015-02-12 16:07:15,103 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0003_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 16:07:15,104 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0003_000001 released container container_1423785972183_0003_01_000002 on node: host: 10.1.1.67:60568 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 16:07:15,734 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:15,735 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0003_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:15,735 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000004
2015-02-12 16:07:15,735 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0003_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 16:07:16,108 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:16,202 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0003_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:07:16,214 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0003_000001 (auth:SIMPLE)
2015-02-12 16:07:16,216 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0003_01_000004 by user soberoi
2015-02-12 16:07:16,217 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000004
2015-02-12 16:07:16,217 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0003_01_000004 to application application_1423785972183_0003
2015-02-12 16:07:16,217 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 16:07:16,217 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0003
2015-02-12 16:07:16,217 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0003
2015-02-12 16:07:16,218 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:07:16,218 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0003
2015-02-12 16:07:16,218 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:07:16,261 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 16:07:16,261 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:16,360 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000004/default_container_executor.sh]
2015-02-12 16:07:16,741 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0003_01_000003]
2015-02-12 16:07:16,742 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0003_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:07:16,742 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:17,110 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0003_01_000002]
2015-02-12 16:07:17,110 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:17,214 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 16:07:17,548 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741856_1032
2015-02-12 16:07:17,549 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741855_1031
2015-02-12 16:07:18,865 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 16:07:18,867 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 16:07:19,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_temporary/1/_temporary/attempt_1423785972183_0003_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:19,153 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_temporary/1/_temporary/attempt_1423785972183_0003_r_000000_0/part-00000. BP-2102022600-10.1.1.67-1423785955551 blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]}
2015-02-12 16:07:19,258 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741858_1034 src: /127.0.0.1:60859 dest: /127.0.0.1:60511
2015-02-12 16:07:19,260 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741858_1034 src: /127.0.0.1:60860 dest: /127.0.0.1:60521
2015-02-12 16:07:19,261 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741858_1034 src: /127.0.0.1:60861 dest: /127.0.0.1:60515
2015-02-12 16:07:19,303 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60861, dest: /127.0.0.1:60515, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423785972183_0003_r_000000_0_741635459_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741858_1034, duration: 39547000
2015-02-12 16:07:19,303 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741858_1034, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:19,303 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:19,304 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60860, dest: /127.0.0.1:60521, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423785972183_0003_r_000000_0_741635459_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741858_1034, duration: 40324000
2015-02-12 16:07:19,304 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741858_1034, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:19,305 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:19,305 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60859, dest: /127.0.0.1:60511, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1423785972183_0003_r_000000_0_741635459_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741858_1034, duration: 41632000
2015-02-12 16:07:19,305 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741858_1034, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:19,306 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:19,312 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_temporary/1/_temporary/attempt_1423785972183_0003_r_000000_0/part-00000 is closed by DFSClient_attempt_1423785972183_0003_r_000000_0_741635459_1
2015-02-12 16:07:19,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_temporary/1/_temporary/attempt_1423785972183_0003_r_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_temporary/1/_temporary/attempt_1423785972183_0003_r_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_temporary/1/task_1423785972183_0003_r_000000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_temporary/1/_temporary/attempt_1423785972183_0003_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_temporary/1/task_1423785972183_0003_r_000000	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 16:07:19,355 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0003_000001 (auth:SIMPLE)
2015-02-12 16:07:19,357 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0003_01_000004
2015-02-12 16:07:19,357 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000004
2015-02-12 16:07:19,357 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000004 transitioned from RUNNING to KILLING
2015-02-12 16:07:19,357 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0003_01_000004
2015-02-12 16:07:19,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:19,370 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_311764385_1
2015-02-12 16:07:19,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_temporary/1	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,381 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0003_01_000004 is : 143
2015-02-12 16:07:19,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_temporary/1/task_1423785972183_0003_r_000000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,398 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:07:19,399 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000004
2015-02-12 16:07:19,399 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000004
2015-02-12 16:07:19,399 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000004
2015-02-12 16:07:19,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_temporary/1/task_1423785972183_0003_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/part-00000	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:19,400 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000004
2015-02-12 16:07:19,400 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:07:19,401 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0003_01_000004 from application application_1423785972183_0003
2015-02-12 16:07:19,401 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:19,401 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0003
2015-02-12 16:07:19,400 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000004
2015-02-12 16:07:19,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,412 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:19,414 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_SUCCESS is closed by DFSClient_NONMAPREDUCE_311764385_1
2015-02-12 16:07:19,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:19,419 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_311764385_1
2015-02-12 16:07:19,437 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60851, dest: /127.0.0.1:60518, bytes: 45765, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_311764385_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741857_1033, duration: 5671103000
2015-02-12 16:07:19,438 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741857_1033, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:19,438 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]} size 14394
2015-02-12 16:07:19,439 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60850, dest: /127.0.0.1:60511, bytes: 45765, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_311764385_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741857_1033, duration: 5672993000
2015-02-12 16:07:19,440 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741857_1033, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:19,440 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]} size 14394
2015-02-12 16:07:19,442 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60849, dest: /127.0.0.1:60521, bytes: 45765, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_311764385_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741857_1033, duration: 5676304000
2015-02-12 16:07:19,442 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741857_1033, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:19,442 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]} size 14394
2015-02-12 16:07:19,445 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job_1423785972183_0003_1.jhist is closed by DFSClient_NONMAPREDUCE_311764385_1
2015-02-12 16:07:19,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:19,452 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003.summary_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]}
2015-02-12 16:07:19,455 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741859_1035 src: /127.0.0.1:60863 dest: /127.0.0.1:60521
2015-02-12 16:07:19,458 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741859_1035 src: /127.0.0.1:60864 dest: /127.0.0.1:60515
2015-02-12 16:07:19,460 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741859_1035 src: /127.0.0.1:60865 dest: /127.0.0.1:60518
2015-02-12 16:07:19,464 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60865, dest: /127.0.0.1:60518, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_311764385_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741859_1035, duration: 2460000
2015-02-12 16:07:19,465 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741859_1035, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:19,465 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:19,465 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60864, dest: /127.0.0.1:60515, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_311764385_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741859_1035, duration: 2429000
2015-02-12 16:07:19,466 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741859_1035, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:19,466 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:19,466 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60863, dest: /127.0.0.1:60521, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_311764385_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741859_1035, duration: 4383000
2015-02-12 16:07:19,467 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741859_1035, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:19,468 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:19,470 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003.summary_tmp is closed by DFSClient_NONMAPREDUCE_311764385_1
2015-02-12 16:07:19,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:19,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job_1423785972183_0003_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,485 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003-1423786022632-soberoi-%5BED5761C72550422D816BADF9668975E8%2F5D5BA5651F094301-1423786039420-2-1-SUCCEEDED-root.soberoi-1423786027120.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job_1423785972183_0003_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003-1423786022632-soberoi-%5BED5761C72550422D816BADF9668975E8%2F5D5BA5651F094301-1423786039420-2-1-SUCCEEDED-root.soberoi-1423786027120.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job_1423785972183_0003_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003-1423786022632-soberoi-%5BED5761C72550422D816BADF9668975E8%2F5D5BA5651F094301-1423786039420-2-1-SUCCEEDED-root.soberoi-1423786027120.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:19,511 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003-1423786022632-soberoi-%5BED5761C72550422D816BADF9668975E8%2F5D5BA5651F094301-1423786039420-2-1-SUCCEEDED-root.soberoi-1423786027120.jhist_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]}
2015-02-12 16:07:19,514 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741860_1036 src: /127.0.0.1:60867 dest: /127.0.0.1:60511
2015-02-12 16:07:19,516 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741860_1036 src: /127.0.0.1:60868 dest: /127.0.0.1:60518
2015-02-12 16:07:19,517 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741860_1036 src: /127.0.0.1:60869 dest: /127.0.0.1:60521
2015-02-12 16:07:19,521 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60869, dest: /127.0.0.1:60521, bytes: 45765, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_311764385_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741860_1036, duration: 1967000
2015-02-12 16:07:19,521 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741860_1036, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:19,522 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]} size 0
2015-02-12 16:07:19,522 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60868, dest: /127.0.0.1:60518, bytes: 45765, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_311764385_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741860_1036, duration: 2749000
2015-02-12 16:07:19,522 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741860_1036, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:19,524 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60867, dest: /127.0.0.1:60511, bytes: 45765, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_311764385_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741860_1036, duration: 4414000
2015-02-12 16:07:19,524 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:19,524 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741860_1036, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:19,526 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:19,528 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003-1423786022632-soberoi-%5BED5761C72550422D816BADF9668975E8%2F5D5BA5651F094301-1423786039420-2-1-SUCCEEDED-root.soberoi-1423786027120.jhist_tmp is closed by DFSClient_NONMAPREDUCE_311764385_1
2015-02-12 16:07:19,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003-1423786022632-soberoi-%5BED5761C72550422D816BADF9668975E8%2F5D5BA5651F094301-1423786039420-2-1-SUCCEEDED-root.soberoi-1423786027120.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:19,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job_1423785972183_0003_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job_1423785972183_0003_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003/job_1423785972183_0003_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:19,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:19,548 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003_conf.xml_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]}
2015-02-12 16:07:19,553 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741861_1037 src: /127.0.0.1:60870 dest: /127.0.0.1:60515
2015-02-12 16:07:19,555 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741861_1037 src: /127.0.0.1:60871 dest: /127.0.0.1:60518
2015-02-12 16:07:19,558 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741861_1037 src: /127.0.0.1:60872 dest: /127.0.0.1:60521
2015-02-12 16:07:19,564 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60872, dest: /127.0.0.1:60521, bytes: 114229, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_311764385_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741861_1037, duration: 3134000
2015-02-12 16:07:19,564 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741861_1037, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:19,566 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60871, dest: /127.0.0.1:60518, bytes: 114229, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_311764385_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741861_1037, duration: 4454000
2015-02-12 16:07:19,566 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741861_1037, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:19,566 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:19,567 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60870, dest: /127.0.0.1:60515, bytes: 114229, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_311764385_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741861_1037, duration: 6286000
2015-02-12 16:07:19,568 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741861_1037, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:19,569 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:19,569 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:19,571 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_311764385_1
2015-02-12 16:07:19,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:19,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:19,581 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:19,583 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003-1423786022632-soberoi-%5BED5761C72550422D816BADF9668975E8%2F5D5BA5651F094301-1423786039420-2-1-SUCCEEDED-root.soberoi-1423786027120.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003-1423786022632-soberoi-%5BED5761C72550422D816BADF9668975E8%2F5D5BA5651F094301-1423786039420-2-1-SUCCEEDED-root.soberoi-1423786027120.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:19,601 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423785972183_0003_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 16:07:19,601 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0003_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 16:07:19,602 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423785972183_0003 with final state: FINISHING
2015-02-12 16:07:19,602 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0003 State change from RUNNING to FINAL_SAVING
2015-02-12 16:07:19,602 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0003_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 16:07:19,602 INFO  recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423785972183_0003
2015-02-12 16:07:19,603 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0003 State change from FINAL_SAVING to FINISHING
2015-02-12 16:07:20,364 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0003_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:07:20,364 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0003_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 16:07:20,364 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000004
2015-02-12 16:07:20,364 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0003_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 16:07:20,365 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0003_000001 released container container_1423785972183_0003_01_000004 on node: host: 10.1.1.67:60564 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 16:07:20,613 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423785972183_0003 unregistered successfully. 
2015-02-12 16:07:20,617 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741851_1027 127.0.0.1:60518 127.0.0.1:60511 127.0.0.1:60515 127.0.0.1:60521 
2015-02-12 16:07:20,618 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741852_1028 127.0.0.1:60521 127.0.0.1:60518 127.0.0.1:60515 127.0.0.1:60511 
2015-02-12 16:07:20,618 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741853_1029 127.0.0.1:60511 127.0.0.1:60521 127.0.0.1:60515 
2015-02-12 16:07:20,619 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741854_1030 127.0.0.1:60518 127.0.0.1:60511 127.0.0.1:60521 
2015-02-12 16:07:20,619 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741856_1032 127.0.0.1:60515 127.0.0.1:60518 127.0.0.1:60521 
2015-02-12 16:07:20,619 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741857_1033 127.0.0.1:60521 127.0.0.1:60511 127.0.0.1:60518 
2015-02-12 16:07:20,619 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741855_1031 127.0.0.1:60511 127.0.0.1:60521 127.0.0.1:60515 
2015-02-12 16:07:20,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0003	dst=null	perm=null	proto=rpc
2015-02-12 16:07:20,661 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741847_1023 127.0.0.1:60521 127.0.0.1:60511 127.0.0.1:60515 
2015-02-12 16:07:20,661 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/7802525623_upper_260A6BBBE01C40668A5B1828C80110D6	dst=null	perm=null	proto=rpc
2015-02-12 16:07:20,663 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741843_1019 127.0.0.1:60521 127.0.0.1:60518 127.0.0.1:60515 
2015-02-12 16:07:20,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/5823253906_lower_D6DD625627B74D5CA0A23E103408A644	dst=null	perm=null	proto=rpc
2015-02-12 16:07:20,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped	dst=null	perm=null	proto=rpc
2015-02-12 16:07:20,666 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_temporary
2015-02-12 16:07:20,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 16:07:20,668 WARN  flow.Flow (BaseFlow.java:logWarn(1388)) - [lower*upper] flow listener cascading.flow.FailingFlowListener@6ec7b34a threw throwable
java.lang.RuntimeException: intentionally failed on: COMPLETED
	at cascading.flow.FailingFlowListener.onCompleted(FailingFlowListener.java:61)
	at cascading.flow.BaseFlow$SafeFlowListener.onCompleted(BaseFlow.java:1556)
	at cascading.flow.BaseFlow.fireOnCompleted(BaseFlow.java:1317)
	at cascading.flow.BaseFlow.run(BaseFlow.java:1201)
	at cascading.flow.BaseFlow.access$100(BaseFlow.java:78)
	at cascading.flow.BaseFlow$1.run(BaseFlow.java:834)
	at java.lang.Thread.run(Thread.java:745)
2015-02-12 16:07:20,673 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] stopping all jobs
2015-02-12 16:07:20,674 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (3/3) ...latform/COMPLETED/stopped
2015-02-12 16:07:20,677 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (2/3)
2015-02-12 16:07:20,734 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60511 to delete [blk_1073741857_1033, blk_1073741847_1023, blk_1073741851_1027, blk_1073741852_1028, blk_1073741853_1029, blk_1073741854_1030, blk_1073741855_1031]
2015-02-12 16:07:20,735 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60515 to delete [blk_1073741856_1032, blk_1073741843_1019, blk_1073741847_1023, blk_1073741851_1027, blk_1073741852_1028, blk_1073741853_1029, blk_1073741855_1031]
2015-02-12 16:07:21,367 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:21,609 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741856 for deletion
2015-02-12 16:07:21,609 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741857 for deletion
2015-02-12 16:07:21,610 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741847 for deletion
2015-02-12 16:07:21,610 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741851 for deletion
2015-02-12 16:07:21,610 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741852 for deletion
2015-02-12 16:07:21,610 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741856
2015-02-12 16:07:21,610 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741857
2015-02-12 16:07:21,610 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741847
2015-02-12 16:07:21,610 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741843 for deletion
2015-02-12 16:07:21,611 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741847 for deletion
2015-02-12 16:07:21,611 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741851 for deletion
2015-02-12 16:07:21,611 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741852 for deletion
2015-02-12 16:07:21,611 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741851
2015-02-12 16:07:21,611 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741852
2015-02-12 16:07:21,612 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741847
2015-02-12 16:07:21,610 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741853 for deletion
2015-02-12 16:07:21,612 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741852
2015-02-12 16:07:21,612 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741853 for deletion
2015-02-12 16:07:21,613 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741853
2015-02-12 16:07:21,611 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741843
2015-02-12 16:07:21,613 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741855 for deletion
2015-02-12 16:07:21,613 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741851
2015-02-12 16:07:21,614 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741853
2015-02-12 16:07:21,612 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741854 for deletion
2015-02-12 16:07:21,614 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741855 for deletion
2015-02-12 16:07:21,614 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741855
2015-02-12 16:07:21,615 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741854
2015-02-12 16:07:21,615 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741855
2015-02-12 16:07:21,684 INFO  ipc.Client (Client.java:handleConnectionFailure(842)) - Retrying connect to server: 10.1.1.67/10.1.1.67:60622. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
2015-02-12 16:07:22,376 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:22,687 INFO  ipc.Client (Client.java:handleConnectionFailure(842)) - Retrying connect to server: 10.1.1.67/10.1.1.67:60622. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
2015-02-12 16:07:23,385 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:23,693 INFO  ipc.Client (Client.java:handleConnectionFailure(842)) - Retrying connect to server: 10.1.1.67/10.1.1.67:60622. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
2015-02-12 16:07:23,738 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60521 to delete [blk_1073741856_1032, blk_1073741857_1033, blk_1073741843_1019, blk_1073741847_1023, blk_1073741851_1027, blk_1073741852_1028, blk_1073741853_1029, blk_1073741854_1030, blk_1073741855_1031]
2015-02-12 16:07:23,738 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60518 to delete [blk_1073741856_1032, blk_1073741857_1033, blk_1073741843_1019, blk_1073741851_1027, blk_1073741852_1028, blk_1073741854_1030]
2015-02-12 16:07:23,806 INFO  mapred.ClientServiceDelegate (ClientServiceDelegate.java:getProxy(273)) - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
2015-02-12 16:07:23,818 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 16:07:23,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:07:23,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001.summary	dst=null	perm=null	proto=rpc
2015-02-12 16:07:23,830 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003.summary	dst=null	perm=null	proto=rpc
2015-02-12 16:07:23,830 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002.summary	dst=null	perm=null	proto=rpc
2015-02-12 16:07:23,834 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423785972183_0001,submitTime=1423785978898,launchTime=1423785986588,firstMapTaskLaunchTime=1423785988811,firstReduceTaskLaunchTime=1423786015851,finishTime=1423786021064,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=118,reduceSlotSeconds=5,jobName=[ED5761C72550422D816BADF9668975E8/4439D5D678CE4AF182849E2F0CE0786D] lower*upper/(1/3)
2015-02-12 16:07:23,834 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001.summary]
2015-02-12 16:07:23,834 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423785972183_0003,submitTime=1423786022632,launchTime=1423786027120,firstMapTaskLaunchTime=1423786029289,firstReduceTaskLaunchTime=1423786036218,finishTime=1423786039420,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=2,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=9,reduceSlotSeconds=3,jobName=[ED5761C72550422D816BADF9668975E8/5D5BA5651F094301834A3E0C299D57C9] lower*upper/(3/3) ...latform/COMPLETED/stopped
2015-02-12 16:07:23,835 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003.summary]
2015-02-12 16:07:23,834 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423785972183_0002,submitTime=1423785978898,launchTime=1423785986823,firstMapTaskLaunchTime=1423785989360,firstReduceTaskLaunchTime=1423786015004,finishTime=1423786020073,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=117,reduceSlotSeconds=4,jobName=[ED5761C72550422D816BADF9668975E8/F23EF9287BD445D4B455F6F5C86EF1B6] lower*upper/(2/3)
2015-02-12 16:07:23,835 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002.summary]
2015-02-12 16:07:23,837 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741848_1024 127.0.0.1:60515 127.0.0.1:60518 127.0.0.1:60511 
2015-02-12 16:07:23,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001.summary	dst=null	perm=null	proto=rpc
2015-02-12 16:07:23,838 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741844_1020 127.0.0.1:60518 127.0.0.1:60511 127.0.0.1:60515 
2015-02-12 16:07:23,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002.summary	dst=null	perm=null	proto=rpc
2015-02-12 16:07:23,838 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741859_1035 127.0.0.1:60521 127.0.0.1:60515 127.0.0.1:60518 
2015-02-12 16:07:23,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003.summary	dst=null	perm=null	proto=rpc
2015-02-12 16:07:23,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:23,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:23,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:23,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:23,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:23,860 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:23,862 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:23,863 INFO  hs.HistoryFileManager (HistoryFileManager.java:makeDoneSubdir(969)) - Perms after creating 504, Expected: 504
2015-02-12 16:07:23,864 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2FF23EF9287BD445D4-1423786020073-5-1-SUCCEEDED-root.soberoi-1423785986823.jhist to hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0002-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2FF23EF9287BD445D4-1423786020073-5-1-SUCCEEDED-root.soberoi-1423785986823.jhist
2015-02-12 16:07:23,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:23,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:23,865 INFO  hs.HistoryFileManager (HistoryFileManager.java:makeDoneSubdir(969)) - Perms after creating 504, Expected: 504
2015-02-12 16:07:23,865 INFO  hs.HistoryFileManager (HistoryFileManager.java:makeDoneSubdir(969)) - Perms after creating 504, Expected: 504
2015-02-12 16:07:23,865 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2F4439D5D678CE4AF1-1423786021064-5-1-SUCCEEDED-root.soberoi-1423785986588.jhist to hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0001-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2F4439D5D678CE4AF1-1423786021064-5-1-SUCCEEDED-root.soberoi-1423785986588.jhist
2015-02-12 16:07:23,865 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003-1423786022632-soberoi-%5BED5761C72550422D816BADF9668975E8%2F5D5BA5651F094301-1423786039420-2-1-SUCCEEDED-root.soberoi-1423786027120.jhist to hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0003-1423786022632-soberoi-%5BED5761C72550422D816BADF9668975E8%2F5D5BA5651F094301-1423786039420-2-1-SUCCEEDED-root.soberoi-1423786027120.jhist
2015-02-12 16:07:23,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003-1423786022632-soberoi-%5BED5761C72550422D816BADF9668975E8%2F5D5BA5651F094301-1423786039420-2-1-SUCCEEDED-root.soberoi-1423786027120.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0003-1423786022632-soberoi-%5BED5761C72550422D816BADF9668975E8%2F5D5BA5651F094301-1423786039420-2-1-SUCCEEDED-root.soberoi-1423786027120.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:23,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2FF23EF9287BD445D4-1423786020073-5-1-SUCCEEDED-root.soberoi-1423785986823.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0002-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2FF23EF9287BD445D4-1423786020073-5-1-SUCCEEDED-root.soberoi-1423785986823.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:23,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2F4439D5D678CE4AF1-1423786021064-5-1-SUCCEEDED-root.soberoi-1423785986588.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0001-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2F4439D5D678CE4AF1-1423786021064-5-1-SUCCEEDED-root.soberoi-1423785986588.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:23,869 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003_conf.xml to hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0003_conf.xml
2015-02-12 16:07:23,869 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002_conf.xml to hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0002_conf.xml
2015-02-12 16:07:23,870 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001_conf.xml to hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0001_conf.xml
2015-02-12 16:07:23,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0003_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0003_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:23,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0001_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0001_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:23,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0002_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0002_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:07:23,879 INFO  hs.CompletedJob (CompletedJob.java:<init>(95)) - Loading job: job_1423785972183_0002 from file: hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0002-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2FF23EF9287BD445D4-1423786020073-5-1-SUCCEEDED-root.soberoi-1423785986823.jhist
2015-02-12 16:07:23,879 INFO  hs.CompletedJob (CompletedJob.java:loadFullHistoryData(326)) - Loading history file: [hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0002-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2FF23EF9287BD445D4-1423786020073-5-1-SUCCEEDED-root.soberoi-1423785986823.jhist]
2015-02-12 16:07:23,881 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0002-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2FF23EF9287BD445D4-1423786020073-5-1-SUCCEEDED-root.soberoi-1423785986823.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:07:23,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0002-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2FF23EF9287BD445D4-1423786020073-5-1-SUCCEEDED-root.soberoi-1423785986823.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:07:24,171 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (1/3)
2015-02-12 16:07:24,391 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:24,993 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741856 for deletion
2015-02-12 16:07:24,993 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741857 for deletion
2015-02-12 16:07:24,993 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741843 for deletion
2015-02-12 16:07:24,993 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741856
2015-02-12 16:07:24,993 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741851 for deletion
2015-02-12 16:07:24,994 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741843
2015-02-12 16:07:24,994 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741857
2015-02-12 16:07:24,994 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741852 for deletion
2015-02-12 16:07:24,995 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741854 for deletion
2015-02-12 16:07:24,995 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741851
2015-02-12 16:07:24,995 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741852
2015-02-12 16:07:24,996 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741854
2015-02-12 16:07:25,177 INFO  ipc.Client (Client.java:handleConnectionFailure(842)) - Retrying connect to server: 10.1.1.67/10.1.1.67:60621. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
2015-02-12 16:07:25,273 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741856 for deletion
2015-02-12 16:07:25,273 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741857 for deletion
2015-02-12 16:07:25,273 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741843 for deletion
2015-02-12 16:07:25,274 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741856
2015-02-12 16:07:25,274 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741847 for deletion
2015-02-12 16:07:25,274 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741851 for deletion
2015-02-12 16:07:25,274 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741852 for deletion
2015-02-12 16:07:25,275 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741853 for deletion
2015-02-12 16:07:25,275 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741851
2015-02-12 16:07:25,274 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741857
2015-02-12 16:07:25,275 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741853
2015-02-12 16:07:25,275 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741854 for deletion
2015-02-12 16:07:25,276 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741855 for deletion
2015-02-12 16:07:25,275 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741843
2015-02-12 16:07:25,276 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741847
2015-02-12 16:07:25,276 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741852
2015-02-12 16:07:25,277 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741854
2015-02-12 16:07:25,277 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741855
2015-02-12 16:07:25,393 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:25,755 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423785972183_0003_01_000001 succeeded 
2015-02-12 16:07:25,756 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 16:07:25,756 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0003_01_000001
2015-02-12 16:07:25,769 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000001
2015-02-12 16:07:25,769 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000001
2015-02-12 16:07:25,770 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000001
2015-02-12 16:07:25,770 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0003/container_1423785972183_0003_01_000001
2015-02-12 16:07:25,770 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000001
2015-02-12 16:07:25,770 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0003_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 16:07:25,770 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0003_01_000001 from application application_1423785972183_0003
2015-02-12 16:07:25,771 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:25,771 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0003
2015-02-12 16:07:26,178 INFO  ipc.Client (Client.java:handleConnectionFailure(842)) - Retrying connect to server: 10.1.1.67/10.1.1.67:60621. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
2015-02-12 16:07:26,402 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0003_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:07:26,402 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423785972183_0003_000001
2015-02-12 16:07:26,402 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0003_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 16:07:26,403 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000001
2015-02-12 16:07:26,403 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0003_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:60564, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 16:07:26,403 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0003_000001 released container container_1423785972183_0003_01_000001 on node: host: 10.1.1.67:60564 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 16:07:26,403 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:26,402 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423785972183_0003_000001
2015-02-12 16:07:26,404 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0003_000001 State change from FINISHING to FINISHED
2015-02-12 16:07:26,404 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0003 State change from FINISHING to FINISHED
2015-02-12 16:07:26,405 INFO  fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423785972183_0003_000001 is done. finalState=FINISHED
2015-02-12 16:07:26,405 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1423785972183_0003
2015-02-12 16:07:26,405 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423785972183_0003 requests cleared
2015-02-12 16:07:26,405 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423785972183_0003,name=[ED5761C72550422D816BADF9668975E8/5D5BA5651F094301834A3E0C299D57C9] lower*upper/(3/3) ...latform/COMPLETED/stopped,user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:60554/proxy/application_1423785972183_0003/jobhistory/job/job_1423785972183_0003,appMasterHost=10.1.1.67,startTime=1423786022632,finishTime=1423786039602,finalStatus=SUCCEEDED
2015-02-12 16:07:26,406 INFO  amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423785972183_0003_000001
2015-02-12 16:07:26,408 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0003_000001 (auth:SIMPLE)
2015-02-12 16:07:26,410 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0003_01_000001
2015-02-12 16:07:26,410 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0003	CONTAINERID=container_1423785972183_0003_01_000001
2015-02-12 16:07:26,411 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0003_01_000001]
2015-02-12 16:07:26,411 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:26,411 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:26,411 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0003 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:07:26,411 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0003
2015-02-12 16:07:26,411 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0003
2015-02-12 16:07:26,412 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0003
2015-02-12 16:07:26,412 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0003
2015-02-12 16:07:26,412 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0003 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:07:26,412 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0003, with delay of 10800 seconds
2015-02-12 16:07:26,413 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0003
2015-02-12 16:07:26,674 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30010 milliseconds
2015-02-12 16:07:26,675 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 16:07:26,739 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60518 to delete [blk_1073741859_1035, blk_1073741844_1020, blk_1073741848_1024]
2015-02-12 16:07:26,740 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60521 to delete [blk_1073741859_1035]
2015-02-12 16:07:27,184 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0003 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:07:27,184 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0003
2015-02-12 16:07:27,185 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0003
2015-02-12 16:07:27,185 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0003
2015-02-12 16:07:27,185 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0003
2015-02-12 16:07:27,186 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0003 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:07:27,186 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0003, with delay of 10800 seconds
2015-02-12 16:07:27,185 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0003
2015-02-12 16:07:27,187 INFO  ipc.Client (Client.java:handleConnectionFailure(842)) - Retrying connect to server: 10.1.1.67/10.1.1.67:60621. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
2015-02-12 16:07:27,295 INFO  mapred.ClientServiceDelegate (ClientServiceDelegate.java:getProxy(273)) - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
2015-02-12 16:07:27,297 INFO  hs.CompletedJob (CompletedJob.java:<init>(95)) - Loading job: job_1423785972183_0001 from file: hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0001-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2F4439D5D678CE4AF1-1423786021064-5-1-SUCCEEDED-root.soberoi-1423785986588.jhist
2015-02-12 16:07:27,297 INFO  hs.CompletedJob (CompletedJob.java:loadFullHistoryData(326)) - Loading history file: [hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0001-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2F4439D5D678CE4AF1-1423786021064-5-1-SUCCEEDED-root.soberoi-1423785986588.jhist]
2015-02-12 16:07:27,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0001-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2F4439D5D678CE4AF1-1423786021064-5-1-SUCCEEDED-root.soberoi-1423785986588.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,299 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0001-1423785978898-soberoi-%5BED5761C72550422D816BADF9668975E8%2F4439D5D678CE4AF1-1423786021064-5-1-SUCCEEDED-root.soberoi-1423785986588.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,389 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] stopped all jobs
2015-02-12 16:07:27,390 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/flowplatform/COMPLETED/stopped
2015-02-12 16:07:27,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/COMPLETED/stopped/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,413 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:27,424 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 16:07:27,425 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 16:07:27,459 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(391)) - calling start
2015-02-12 16:07:27,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/THROWABLE/stopped	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,463 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 16:07:27,463 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-02-12 16:07:27,463 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 16:07:27,463 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/THROWABLE/stopped"]
2015-02-12 16:07:27,463 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  parallel execution is enabled: true
2015-02-12 16:07:27,463 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  starting jobs: 3
2015-02-12 16:07:27,464 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  allocating threads: 3
2015-02-12 16:07:27,465 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/3)
2015-02-12 16:07:27,466 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (2/3)
2015-02-12 16:07:27,483 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:60553
2015-02-12 16:07:27,496 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:60553
2015-02-12 16:07:27,506 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:60553
2015-02-12 16:07:27,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,512 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,515 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 4
2015-02-12 16:07:27,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 16:07:27,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 16:07:27,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:27,532 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:60553
2015-02-12 16:07:27,534 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar. BP-2102022600-10.1.1.67-1423785955551 blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]}
2015-02-12 16:07:27,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3721187720_lower_A1877AA73DB348179CF770A6EF14E5AC	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,537 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741862_1038 src: /127.0.0.1:60889 dest: /127.0.0.1:60511
2015-02-12 16:07:27,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,538 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741862_1038 src: /127.0.0.1:60890 dest: /127.0.0.1:60518
2015-02-12 16:07:27,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,540 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741862_1038 src: /127.0.0.1:60891 dest: /127.0.0.1:60515
2015-02-12 16:07:27,540 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 5
2015-02-12 16:07:27,544 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,546 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60891, dest: /127.0.0.1:60515, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741862_1038, duration: 3208000
2015-02-12 16:07:27,547 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741862_1038, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:27,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 16:07:27,548 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60890, dest: /127.0.0.1:60518, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741862_1038, duration: 4757000
2015-02-12 16:07:27,548 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:27,548 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741862_1038, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:27,549 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60889, dest: /127.0.0.1:60511, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741862_1038, duration: 6703000
2015-02-12 16:07:27,550 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741862_1038, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:27,552 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:27,553 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:27,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 16:07:27,554 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:07:27,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,555 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar
2015-02-12 16:07:27,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:27,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:27,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,561 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar. BP-2102022600-10.1.1.67-1423785955551 blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:07:27,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,562 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741861_1037
2015-02-12 16:07:27,563 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741858_1034
2015-02-12 16:07:27,563 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741863_1039 src: /127.0.0.1:60892 dest: /127.0.0.1:60515
2015-02-12 16:07:27,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,564 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741859_1035
2015-02-12 16:07:27,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,565 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741863_1039 src: /127.0.0.1:60893 dest: /127.0.0.1:60518
2015-02-12 16:07:27,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,567 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741863_1039 src: /127.0.0.1:60894 dest: /127.0.0.1:60511
2015-02-12 16:07:27,567 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,569 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,571 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60894, dest: /127.0.0.1:60511, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741863_1039, duration: 2306000
2015-02-12 16:07:27,572 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741863_1039, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:27,573 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60893, dest: /127.0.0.1:60518, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741863_1039, duration: 3209000
2015-02-12 16:07:27,573 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:27,574 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60892, dest: /127.0.0.1:60515, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741863_1039, duration: 4711000
2015-02-12 16:07:27,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,575 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:27,574 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741863_1039, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:27,573 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741863_1039, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:27,577 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 16:07:27,581 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:27,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,582 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:07:27,585 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar
2015-02-12 16:07:27,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:27,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:27,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:27,594 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.split
2015-02-12 16:07:27,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,598 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.split. BP-2102022600-10.1.1.67-1423785955551 blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]}
2015-02-12 16:07:27,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,600 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,600 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741864_1040 src: /127.0.0.1:60895 dest: /127.0.0.1:60518
2015-02-12 16:07:27,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,602 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741864_1040 src: /127.0.0.1:60896 dest: /127.0.0.1:60511
2015-02-12 16:07:27,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,604 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741864_1040 src: /127.0.0.1:60897 dest: /127.0.0.1:60515
2015-02-12 16:07:27,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,605 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741864_1040 src: /127.0.0.1:60898 dest: /127.0.0.1:60521
2015-02-12 16:07:27,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,609 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 16:07:27,609 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60898, dest: /127.0.0.1:60521, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741864_1040, duration: 2031000
2015-02-12 16:07:27,610 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741864_1040, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:27,611 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60897, dest: /127.0.0.1:60515, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741864_1040, duration: 3146000
2015-02-12 16:07:27,611 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741864_1040, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:27,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,612 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]} size 0
2015-02-12 16:07:27,612 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60896, dest: /127.0.0.1:60511, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741864_1040, duration: 4805000
2015-02-12 16:07:27,613 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741864_1040, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:27,613 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]} size 0
2015-02-12 16:07:27,614 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:27,614 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60895, dest: /127.0.0.1:60518, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741864_1040, duration: 6551000
2015-02-12 16:07:27,615 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741864_1040, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:27,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:27,618 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:27,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:27,620 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.split is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:07:27,620 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split
2015-02-12 16:07:27,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:27,622 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split. BP-2102022600-10.1.1.67-1423785955551 blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]}
2015-02-12 16:07:27,624 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:27,625 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741865_1041 src: /127.0.0.1:60899 dest: /127.0.0.1:60511
2015-02-12 16:07:27,627 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.splitmetainfo. BP-2102022600-10.1.1.67-1423785955551 blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]}
2015-02-12 16:07:27,628 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741865_1041 src: /127.0.0.1:60900 dest: /127.0.0.1:60515
2015-02-12 16:07:27,630 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741865_1041 src: /127.0.0.1:60901 dest: /127.0.0.1:60521
2015-02-12 16:07:27,630 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741866_1042 src: /127.0.0.1:60902 dest: /127.0.0.1:60518
2015-02-12 16:07:27,632 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741866_1042 src: /127.0.0.1:60904 dest: /127.0.0.1:60511
2015-02-12 16:07:27,632 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741865_1041 src: /127.0.0.1:60903 dest: /127.0.0.1:60518
2015-02-12 16:07:27,634 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741866_1042 src: /127.0.0.1:60905 dest: /127.0.0.1:60515
2015-02-12 16:07:27,641 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60903, dest: /127.0.0.1:60518, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741865_1041, duration: 5901000
2015-02-12 16:07:27,641 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741865_1041, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:27,642 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:27,642 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60901, dest: /127.0.0.1:60521, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741865_1041, duration: 7530000
2015-02-12 16:07:27,643 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741865_1041, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:27,643 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60905, dest: /127.0.0.1:60515, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741866_1042, duration: 4985000
2015-02-12 16:07:27,643 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:27,643 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741866_1042, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:27,643 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60900, dest: /127.0.0.1:60515, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741865_1041, duration: 9374000
2015-02-12 16:07:27,644 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741865_1041, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:27,644 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]} size 0
2015-02-12 16:07:27,644 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60904, dest: /127.0.0.1:60511, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741866_1042, duration: 3254000
2015-02-12 16:07:27,645 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60899, dest: /127.0.0.1:60511, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741865_1041, duration: 10979000
2015-02-12 16:07:27,645 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741865_1041, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:27,645 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:27,645 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741866_1042, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:27,646 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60902, dest: /127.0.0.1:60518, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741866_1042, duration: 4920000
2015-02-12 16:07:27,648 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741866_1042, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:27,649 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:27,651 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:27,652 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:07:27,652 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741865_1041 size 1787
2015-02-12 16:07:27,653 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:07:27,654 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 16:07:27,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:27,656 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:27,656 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:27,658 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.splitmetainfo. BP-2102022600-10.1.1.67-1423785955551 blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]}
2015-02-12 16:07:27,658 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:27,660 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741867_1043 src: /127.0.0.1:60906 dest: /127.0.0.1:60518
2015-02-12 16:07:27,661 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741867_1043 src: /127.0.0.1:60907 dest: /127.0.0.1:60511
2015-02-12 16:07:27,662 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741867_1043 src: /127.0.0.1:60908 dest: /127.0.0.1:60521
2015-02-12 16:07:27,665 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60908, dest: /127.0.0.1:60521, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741867_1043, duration: 1560000
2015-02-12 16:07:27,666 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741867_1043, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:27,666 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]} size 0
2015-02-12 16:07:27,666 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60907, dest: /127.0.0.1:60511, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741867_1043, duration: 2166000
2015-02-12 16:07:27,667 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741867_1043, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:27,667 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]} size 0
2015-02-12 16:07:27,668 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60906, dest: /127.0.0.1:60518, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741867_1043, duration: 3218000
2015-02-12 16:07:27,668 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741867_1043, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:27,669 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:27,670 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:07:27,671 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 16:07:27,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:27,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:07:27,678 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml. BP-2102022600-10.1.1.67-1423785955551 blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:07:27,680 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741868_1044 src: /127.0.0.1:60909 dest: /127.0.0.1:60515
2015-02-12 16:07:27,682 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741868_1044 src: /127.0.0.1:60910 dest: /127.0.0.1:60521
2015-02-12 16:07:27,684 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741868_1044 src: /127.0.0.1:60911 dest: /127.0.0.1:60511
2015-02-12 16:07:27,688 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml. BP-2102022600-10.1.1.67-1423785955551 blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]}
2015-02-12 16:07:27,691 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741869_1045 src: /127.0.0.1:60912 dest: /127.0.0.1:60521
2015-02-12 16:07:27,692 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60911, dest: /127.0.0.1:60511, bytes: 96390, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741868_1044, duration: 3792000
2015-02-12 16:07:27,692 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741868_1044, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:27,693 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60910, dest: /127.0.0.1:60521, bytes: 96390, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741868_1044, duration: 4045000
2015-02-12 16:07:27,693 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 0
2015-02-12 16:07:27,694 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:27,694 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741869_1045 src: /127.0.0.1:60913 dest: /127.0.0.1:60515
2015-02-12 16:07:27,695 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60909, dest: /127.0.0.1:60515, bytes: 96390, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741868_1044, duration: 6186000
2015-02-12 16:07:27,695 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741868_1044, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:27,694 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741868_1044, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:27,698 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741869_1045 src: /127.0.0.1:60914 dest: /127.0.0.1:60511
2015-02-12 16:07:27,698 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:27,701 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:07:27,702 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423785972183_0004
2015-02-12 16:07:27,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,703 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60914, dest: /127.0.0.1:60511, bytes: 96870, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741869_1045, duration: 3288000
2015-02-12 16:07:27,704 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741869_1045, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:27,705 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60913, dest: /127.0.0.1:60515, bytes: 96870, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741869_1045, duration: 4431000
2015-02-12 16:07:27,705 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741869_1045, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:27,706 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]} size 0
2015-02-12 16:07:27,707 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60912, dest: /127.0.0.1:60521, bytes: 96870, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741869_1045, duration: 6484000
2015-02-12 16:07:27,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,707 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741869_1045, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:27,710 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]} size 0
2015-02-12 16:07:27,711 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]} size 0
2015-02-12 16:07:27,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,713 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:07:27,714 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423785972183_0005
2015-02-12 16:07:27,714 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,731 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 4 submitted by user soberoi
2015-02-12 16:07:27,731 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423785972183_0004
2015-02-12 16:07:27,731 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi	IP=10.1.1.67	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423785972183_0004
2015-02-12 16:07:27,731 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423785972183_0004
2015-02-12 16:07:27,731 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0004 State change from NEW to NEW_SAVING
2015-02-12 16:07:27,732 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0004 State change from NEW_SAVING to SUBMITTED
2015-02-12 16:07:27,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,732 INFO  fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423785972183_0004 from user: soberoi, in queue: default, currently num of applications: 1
2015-02-12 16:07:27,732 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0004 State change from SUBMITTED to ACCEPTED
2015-02-12 16:07:27,732 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423785972183_0004_000001
2015-02-12 16:07:27,733 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0004_000001 State change from NEW to SUBMITTED
2015-02-12 16:07:27,733 INFO  fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423785972183_0004_000001 to scheduler from user: soberoi
2015-02-12 16:07:27,734 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0004_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 16:07:27,734 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423785972183_0004
2015-02-12 16:07:27,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,737 INFO  mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:60554/proxy/application_1423785972183_0004/
2015-02-12 16:07:27,737 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423785972183_0004
2015-02-12 16:07:27,737 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60554/proxy/application_1423785972183_0004/
2015-02-12 16:07:27,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:27,747 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 5 submitted by user soberoi
2015-02-12 16:07:27,747 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423785972183_0005
2015-02-12 16:07:27,747 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi	IP=10.1.1.67	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423785972183_0005
2015-02-12 16:07:27,747 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423785972183_0005
2015-02-12 16:07:27,747 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0005 State change from NEW to NEW_SAVING
2015-02-12 16:07:27,748 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0005 State change from NEW_SAVING to SUBMITTED
2015-02-12 16:07:27,748 INFO  fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423785972183_0005 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 16:07:27,748 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0005 State change from SUBMITTED to ACCEPTED
2015-02-12 16:07:27,749 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423785972183_0005_000001
2015-02-12 16:07:27,749 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0005_000001 State change from NEW to SUBMITTED
2015-02-12 16:07:27,749 INFO  fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423785972183_0005_000001 to scheduler from user: soberoi
2015-02-12 16:07:27,750 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0005_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 16:07:27,751 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423785972183_0005
2015-02-12 16:07:27,756 INFO  mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:60554/proxy/application_1423785972183_0005/
2015-02-12 16:07:27,756 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423785972183_0005
2015-02-12 16:07:27,756 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60554/proxy/application_1423785972183_0005/
2015-02-12 16:07:27,913 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:27,913 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000001
2015-02-12 16:07:27,913 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0004_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:60560, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 16:07:27,914 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60560 for container : container_1423785972183_0004_01_000001
2015-02-12 16:07:27,914 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:07:27,914 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423785972183_0004_000001
2015-02-12 16:07:27,915 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423785972183_0004 AttemptId: appattempt_1423785972183_0004_000001 MasterContainer: Container: [ContainerId: container_1423785972183_0004_01_000001, NodeId: 10.1.1.67:60560, NodeHttpAddress: 10.1.1.67:60563, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60560 }, ]
2015-02-12 16:07:27,915 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0004_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 16:07:27,915 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0004_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 16:07:27,916 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423785972183_0004_000001
2015-02-12 16:07:27,917 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423785972183_0004_01_000001, NodeId: 10.1.1.67:60560, NodeHttpAddress: 10.1.1.67:60563, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60560 }, ] for AM appattempt_1423785972183_0004_000001
2015-02-12 16:07:27,917 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423785972183_0004_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 16:07:27,918 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423785972183_0004_000001
2015-02-12 16:07:27,918 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423785972183_0004_000001
2015-02-12 16:07:27,921 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0004_000001 (auth:SIMPLE)
2015-02-12 16:07:27,924 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0004_01_000001 by user soberoi
2015-02-12 16:07:27,924 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0004
2015-02-12 16:07:27,924 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000001
2015-02-12 16:07:27,925 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0004 transitioned from NEW to INITING
2015-02-12 16:07:27,925 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0004_01_000001 to application application_1423785972183_0004
2015-02-12 16:07:27,925 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423785972183_0004_01_000001, NodeId: 10.1.1.67:60560, NodeHttpAddress: 10.1.1.67:60563, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60560 }, ] for AM appattempt_1423785972183_0004_000001
2015-02-12 16:07:27,925 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0004 transitioned from INITING to RUNNING
2015-02-12 16:07:27,925 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0004_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 16:07:27,925 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 16:07:27,926 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0004
2015-02-12 16:07:27,926 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:07:27,926 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 16:07:27,926 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.split transitioned from INIT to DOWNLOADING
2015-02-12 16:07:27,926 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:07:27,927 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0004_01_000001
2015-02-12 16:07:27,937 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423785972183_0004_01_000001.tokens. Credentials list: 
2015-02-12 16:07:27,943 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741858_1034
2015-02-12 16:07:27,943 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741860_1036
2015-02-12 16:07:27,993 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741859 for deletion
2015-02-12 16:07:27,994 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741844 for deletion
2015-02-12 16:07:27,994 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741848 for deletion
2015-02-12 16:07:27,994 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741859
2015-02-12 16:07:27,994 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741848
2015-02-12 16:07:27,995 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741844
2015-02-12 16:07:28,066 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:07:28,163 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423785972183_0004_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000001.tokens
2015-02-12 16:07:28,163 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:07:28,174 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:28,174 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000001
2015-02-12 16:07:28,175 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:60556, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 16:07:28,175 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60556 for container : container_1423785972183_0005_01_000001
2015-02-12 16:07:28,176 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:07:28,176 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423785972183_0005_000001
2015-02-12 16:07:28,176 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423785972183_0005 AttemptId: appattempt_1423785972183_0005_000001 MasterContainer: Container: [ContainerId: container_1423785972183_0005_01_000001, NodeId: 10.1.1.67:60556, NodeHttpAddress: 10.1.1.67:60559, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60556 }, ]
2015-02-12 16:07:28,176 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0005_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 16:07:28,178 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0005_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 16:07:28,179 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741860_1036
2015-02-12 16:07:28,182 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741861_1037
2015-02-12 16:07:28,183 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423785972183_0005_000001
2015-02-12 16:07:28,188 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423785972183_0005_01_000001, NodeId: 10.1.1.67:60556, NodeHttpAddress: 10.1.1.67:60559, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60556 }, ] for AM appattempt_1423785972183_0005_000001
2015-02-12 16:07:28,188 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423785972183_0005_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 16:07:28,188 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423785972183_0005_000001
2015-02-12 16:07:28,188 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423785972183_0005_000001
2015-02-12 16:07:28,197 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:07:28,201 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000001 by user soberoi
2015-02-12 16:07:28,201 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0005
2015-02-12 16:07:28,201 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000001
2015-02-12 16:07:28,202 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0005 transitioned from NEW to INITING
2015-02-12 16:07:28,202 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000001 to application application_1423785972183_0005
2015-02-12 16:07:28,202 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423785972183_0005_01_000001, NodeId: 10.1.1.67:60556, NodeHttpAddress: 10.1.1.67:60559, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60556 }, ] for AM appattempt_1423785972183_0005_000001
2015-02-12 16:07:28,202 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0005 transitioned from INITING to RUNNING
2015-02-12 16:07:28,203 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0005_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 16:07:28,203 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 16:07:28,203 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:07:28,204 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:07:28,204 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 16:07:28,204 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split transitioned from INIT to DOWNLOADING
2015-02-12 16:07:28,204 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:07:28,204 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0005_01_000001
2015-02-12 16:07:28,219 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423785972183_0005_01_000001.tokens. Credentials list: 
2015-02-12 16:07:28,275 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741859 for deletion
2015-02-12 16:07:28,275 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741859
2015-02-12 16:07:28,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:28,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:28,347 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0004/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:28,379 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:07:28,381 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:07:28,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:07:28,430 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0004/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:28,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:28,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:28,513 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423785972183_0005_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000001.tokens
2015-02-12 16:07:28,513 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:07:28,514 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0004/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:28,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:28,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:28,604 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0004/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:28,604 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:07:28,640 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:28,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:28,650 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 16:07:28,651 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:28,662 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741858_1034
2015-02-12 16:07:28,663 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741860_1036
2015-02-12 16:07:28,665 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741861_1037
2015-02-12 16:07:28,702 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0005/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:28,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:07:28,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:07:28,793 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0005/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:28,806 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000001/default_container_executor.sh]
2015-02-12 16:07:28,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:28,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:28,876 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0005/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:28,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:28,905 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:28,917 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:07:28,952 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0005/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:28,952 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:07:28,999 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 16:07:28,999 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:29,145 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000001/default_container_executor.sh]
2015-02-12 16:07:29,176 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:07:29,741 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:60511 to replicate blk_1073741862_1038 to datanode(s) 127.0.0.1:60521
2015-02-12 16:07:29,741 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:60515 to replicate blk_1073741863_1039 to datanode(s) 127.0.0.1:60521
2015-02-12 16:07:29,741 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60511 to delete [blk_1073741844_1020, blk_1073741848_1024]
2015-02-12 16:07:29,741 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60515 to delete [blk_1073741859_1035, blk_1073741844_1020, blk_1073741848_1024]
2015-02-12 16:07:30,621 INFO  datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=3ba35078-bb62-4777-80dc-a38267fd3486, infoPort=60516, ipcPort=60517, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0) Starting thread to transfer BP-2102022600-10.1.1.67-1423785955551:blk_1073741863_1039 to 127.0.0.1:60521 
2015-02-12 16:07:30,622 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741859 for deletion
2015-02-12 16:07:30,622 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741844 for deletion
2015-02-12 16:07:30,622 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741848 for deletion
2015-02-12 16:07:30,623 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741859
2015-02-12 16:07:30,623 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741848
2015-02-12 16:07:30,623 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741844
2015-02-12 16:07:30,624 INFO  datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-2102022600-10.1.1.67-1423785955551:blk_1073741863_1039 (numBytes=254067) to /127.0.0.1:60521
2015-02-12 16:07:30,624 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741863_1039 src: /127.0.0.1:60937 dest: /127.0.0.1:60521
2015-02-12 16:07:30,625 INFO  datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=82d30123-0426-431b-a65c-18a9266604fb, infoPort=60512, ipcPort=60513, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0) Starting thread to transfer BP-2102022600-10.1.1.67-1423785955551:blk_1073741862_1038 to 127.0.0.1:60521 
2015-02-12 16:07:30,626 INFO  datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-2102022600-10.1.1.67-1423785955551:blk_1073741863_1039 src: /127.0.0.1:60937 dest: /127.0.0.1:60521 of size 254067
2015-02-12 16:07:30,626 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741844 for deletion
2015-02-12 16:07:30,626 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741848 for deletion
2015-02-12 16:07:30,627 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741844
2015-02-12 16:07:30,627 INFO  datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-2102022600-10.1.1.67-1423785955551:blk_1073741862_1038 (numBytes=254067) to /127.0.0.1:60521
2015-02-12 16:07:30,627 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741848
2015-02-12 16:07:30,627 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741863_1039 size 254067
2015-02-12 16:07:30,627 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741862_1038 src: /127.0.0.1:60938 dest: /127.0.0.1:60521
2015-02-12 16:07:30,630 INFO  datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-2102022600-10.1.1.67-1423785955551:blk_1073741862_1038 src: /127.0.0.1:60938 dest: /127.0.0.1:60521 of size 254067
2015-02-12 16:07:30,631 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741862_1038 size 254067
2015-02-12 16:07:31,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:07:31,853 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 16:07:31,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 16:07:31,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 16:07:31,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004	dst=null	perm=null	proto=rpc
2015-02-12 16:07:31,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 16:07:31,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:07:32,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:07:32,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 16:07:32,081 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 16:07:32,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 16:07:32,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005	dst=null	perm=null	proto=rpc
2015-02-12 16:07:32,214 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 16:07:32,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:07:32,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:07:32,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:07:32,627 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:07:32,636 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:07:32,781 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741862_1038
2015-02-12 16:07:32,952 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741866_1042
2015-02-12 16:07:32,954 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741862_1038
2015-02-12 16:07:32,954 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741865_1041
2015-02-12 16:07:33,162 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741863_1039
2015-02-12 16:07:33,163 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741867_1043
2015-02-12 16:07:33,163 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741864_1040
2015-02-12 16:07:33,192 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741862_1038
2015-02-12 16:07:33,193 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741867_1043
2015-02-12 16:07:33,359 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741868_1044
2015-02-12 16:07:33,360 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741869_1045
2015-02-12 16:07:33,593 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741863_1039
2015-02-12 16:07:33,593 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741866_1042
2015-02-12 16:07:33,594 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741864_1040
2015-02-12 16:07:33,594 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741865_1041
2015-02-12 16:07:33,668 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741864_1040
2015-02-12 16:07:33,669 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741868_1044
2015-02-12 16:07:33,671 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741869_1045
2015-02-12 16:07:33,672 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741867_1043
2015-02-12 16:07:33,673 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741865_1041
2015-02-12 16:07:33,997 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0004_000001 (auth:SIMPLE)
2015-02-12 16:07:34,006 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423785972183_0004_000001
2015-02-12 16:07:34,007 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi	IP=10.1.1.67	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423785972183_0004	APPATTEMPTID=appattempt_1423785972183_0004_000001
2015-02-12 16:07:34,007 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0004_000001 State change from LAUNCHED to RUNNING
2015-02-12 16:07:34,007 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0004 State change from ACCEPTED to RUNNING
2015-02-12 16:07:34,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job_1423785972183_0004_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:34,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 16:07:34,192 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job_1423785972183_0004_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:34,431 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:07:34,434 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423785972183_0005_000001
2015-02-12 16:07:34,434 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi	IP=10.1.1.67	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423785972183_0005	APPATTEMPTID=appattempt_1423785972183_0005_000001
2015-02-12 16:07:34,434 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0005_000001 State change from LAUNCHED to RUNNING
2015-02-12 16:07:34,434 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0005 State change from ACCEPTED to RUNNING
2015-02-12 16:07:34,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job_1423785972183_0005_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:34,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/3721187720_lower_A1877AA73DB348179CF770A6EF14E5AC/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 16:07:34,684 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job_1423785972183_0005_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:34,806 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job_1423785972183_0004_1_conf.xml. BP-2102022600-10.1.1.67-1423785955551 blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]}
2015-02-12 16:07:34,862 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741870_1046 src: /127.0.0.1:60953 dest: /127.0.0.1:60511
2015-02-12 16:07:34,863 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741870_1046 src: /127.0.0.1:60954 dest: /127.0.0.1:60521
2015-02-12 16:07:34,865 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741870_1046 src: /127.0.0.1:60955 dest: /127.0.0.1:60518
2015-02-12 16:07:34,949 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60955, dest: /127.0.0.1:60518, bytes: 113219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_115437968_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741870_1046, duration: 81824000
2015-02-12 16:07:34,949 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741870_1046, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:34,950 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:34,950 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60954, dest: /127.0.0.1:60521, bytes: 113219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_115437968_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741870_1046, duration: 82834000
2015-02-12 16:07:34,951 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741870_1046, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:34,952 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60953, dest: /127.0.0.1:60511, bytes: 113219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_115437968_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741870_1046, duration: 85203000
2015-02-12 16:07:34,952 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:34,953 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:34,952 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741870_1046, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:34,959 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job_1423785972183_0004_1_conf.xml is closed by DFSClient_NONMAPREDUCE_115437968_1
2015-02-12 16:07:34,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job_1423785972183_0004.summary	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:34,997 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job_1423785972183_0004.summary. BP-2102022600-10.1.1.67-1423785955551 blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]}
2015-02-12 16:07:34,999 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741871_1047 src: /127.0.0.1:60956 dest: /127.0.0.1:60511
2015-02-12 16:07:35,001 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741871_1047 src: /127.0.0.1:60957 dest: /127.0.0.1:60521
2015-02-12 16:07:35,002 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741871_1047 src: /127.0.0.1:60958 dest: /127.0.0.1:60518
2015-02-12 16:07:35,006 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60958, dest: /127.0.0.1:60518, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_115437968_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741871_1047, duration: 1627000
2015-02-12 16:07:35,006 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741871_1047, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:35,006 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]} size 0
2015-02-12 16:07:35,006 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60957, dest: /127.0.0.1:60521, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_115437968_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741871_1047, duration: 2257000
2015-02-12 16:07:35,007 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741871_1047, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:35,008 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60956, dest: /127.0.0.1:60511, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_115437968_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741871_1047, duration: 3560000
2015-02-12 16:07:35,008 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]} size 0
2015-02-12 16:07:35,008 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741871_1047, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:35,009 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]} size 0
2015-02-12 16:07:35,020 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job_1423785972183_0004.summary is closed by DFSClient_NONMAPREDUCE_115437968_1
2015-02-12 16:07:35,192 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:35,192 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000002
2015-02-12 16:07:35,192 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0004_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 16:07:35,220 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:35,220 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000003
2015-02-12 16:07:35,220 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0004_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 16:07:35,252 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job_1423785972183_0005_1_conf.xml. BP-2102022600-10.1.1.67-1423785955551 blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:07:35,313 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741872_1048 src: /127.0.0.1:60959 dest: /127.0.0.1:60515
2015-02-12 16:07:35,314 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741872_1048 src: /127.0.0.1:60960 dest: /127.0.0.1:60521
2015-02-12 16:07:35,317 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741872_1048 src: /127.0.0.1:60961 dest: /127.0.0.1:60511
2015-02-12 16:07:35,356 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60961, dest: /127.0.0.1:60511, bytes: 113699, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1318689195_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741872_1048, duration: 37306000
2015-02-12 16:07:35,357 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741872_1048, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:35,357 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 0
2015-02-12 16:07:35,357 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60960, dest: /127.0.0.1:60521, bytes: 113699, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1318689195_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741872_1048, duration: 38141000
2015-02-12 16:07:35,358 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741872_1048, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:35,358 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:35,359 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60959, dest: /127.0.0.1:60515, bytes: 113699, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1318689195_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741872_1048, duration: 39686000
2015-02-12 16:07:35,359 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741872_1048, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:35,360 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:35,368 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job_1423785972183_0005_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1318689195_1
2015-02-12 16:07:35,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job_1423785972183_0005.summary	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:07:35,403 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job_1423785972183_0005.summary. BP-2102022600-10.1.1.67-1423785955551 blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]}
2015-02-12 16:07:35,406 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741873_1049 src: /127.0.0.1:60962 dest: /127.0.0.1:60521
2015-02-12 16:07:35,409 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741873_1049 src: /127.0.0.1:60963 dest: /127.0.0.1:60518
2015-02-12 16:07:35,410 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741873_1049 src: /127.0.0.1:60964 dest: /127.0.0.1:60515
2015-02-12 16:07:35,415 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60964, dest: /127.0.0.1:60515, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1318689195_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741873_1049, duration: 2502000
2015-02-12 16:07:35,415 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741873_1049, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:07:35,416 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60963, dest: /127.0.0.1:60518, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1318689195_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741873_1049, duration: 3753000
2015-02-12 16:07:35,417 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741873_1049, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:35,421 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:60962, dest: /127.0.0.1:60521, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1318689195_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741873_1049, duration: 6251000
2015-02-12 16:07:35,422 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741873_1049, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:07:35,423 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]} size 0
2015-02-12 16:07:35,426 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:35,427 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:07:35,432 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job_1423785972183_0005.summary is closed by DFSClient_NONMAPREDUCE_-1318689195_1
2015-02-12 16:07:35,450 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:35,450 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000004
2015-02-12 16:07:35,450 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0004_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 16:07:35,950 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:35,950 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000002
2015-02-12 16:07:35,950 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 16:07:36,106 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60556 for container : container_1423785972183_0004_01_000002
2015-02-12 16:07:36,107 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:07:36,107 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60568 for container : container_1423785972183_0004_01_000003
2015-02-12 16:07:36,108 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:07:36,108 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60564 for container : container_1423785972183_0004_01_000004
2015-02-12 16:07:36,108 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:07:36,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,153 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,193 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:36,193 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000003
2015-02-12 16:07:36,193 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 16:07:36,197 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,202 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,222 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:36,223 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000004
2015-02-12 16:07:36,223 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 16:07:36,300 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0004_000001 (auth:SIMPLE)
2015-02-12 16:07:36,300 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0004_000001 (auth:SIMPLE)
2015-02-12 16:07:36,300 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0004_000001 (auth:SIMPLE)
2015-02-12 16:07:36,305 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0004_01_000004 by user soberoi
2015-02-12 16:07:36,306 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0004
2015-02-12 16:07:36,306 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000004
2015-02-12 16:07:36,306 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0004 transitioned from NEW to INITING
2015-02-12 16:07:36,307 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0004_01_000004 to application application_1423785972183_0004
2015-02-12 16:07:36,305 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0004_01_000002 by user soberoi
2015-02-12 16:07:36,307 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0004
2015-02-12 16:07:36,307 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0004 transitioned from INITING to RUNNING
2015-02-12 16:07:36,307 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0004 transitioned from NEW to INITING
2015-02-12 16:07:36,308 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0004_01_000002 to application application_1423785972183_0004
2015-02-12 16:07:36,308 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 16:07:36,308 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0004
2015-02-12 16:07:36,308 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0004
2015-02-12 16:07:36,308 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:07:36,308 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0004
2015-02-12 16:07:36,306 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0004_01_000003 by user soberoi
2015-02-12 16:07:36,309 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0004
2015-02-12 16:07:36,309 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000003
2015-02-12 16:07:36,308 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:07:36,309 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:07:36,309 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0004_01_000004
2015-02-12 16:07:36,308 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0004 transitioned from INITING to RUNNING
2015-02-12 16:07:36,311 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 16:07:36,311 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0004
2015-02-12 16:07:36,311 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0004
2015-02-12 16:07:36,311 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:07:36,311 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0004
2015-02-12 16:07:36,312 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:07:36,312 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:07:36,312 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0004_01_000002
2015-02-12 16:07:36,307 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000002
2015-02-12 16:07:36,310 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0004 transitioned from NEW to INITING
2015-02-12 16:07:36,313 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0004_01_000003 to application application_1423785972183_0004
2015-02-12 16:07:36,313 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0004 transitioned from INITING to RUNNING
2015-02-12 16:07:36,314 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 16:07:36,314 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0004
2015-02-12 16:07:36,314 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0004
2015-02-12 16:07:36,314 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:07:36,314 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0004
2015-02-12 16:07:36,315 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:07:36,315 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:07:36,315 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0004_01_000003
2015-02-12 16:07:36,337 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423785972183_0004_01_000004.tokens. Credentials list: 
2015-02-12 16:07:36,338 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423785972183_0004_01_000002.tokens. Credentials list: 
2015-02-12 16:07:36,339 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423785972183_0004_01_000003.tokens. Credentials list: 
2015-02-12 16:07:36,452 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:07:36,453 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:36,453 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000005
2015-02-12 16:07:36,453 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0004_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 16:07:36,558 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:07:36,559 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:07:36,568 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60560 for container : container_1423785972183_0005_01_000002
2015-02-12 16:07:36,569 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:07:36,569 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:07:36,569 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60556 for container : container_1423785972183_0005_01_000003
2015-02-12 16:07:36,570 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:07:36,570 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60568 for container : container_1423785972183_0005_01_000004
2015-02-12 16:07:36,570 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:07:36,678 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,684 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,752 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1423785972183_0004_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000002.tokens
2015-02-12 16:07:36,752 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:07:36,766 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1423785972183_0004_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000003.tokens
2015-02-12 16:07:36,767 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:07:36,768 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423785972183_0004_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000004.tokens
2015-02-12 16:07:36,769 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:07:36,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,810 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,918 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,918 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,924 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,926 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:36,950 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:36,951 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000005
2015-02-12 16:07:36,951 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 16:07:37,005 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0004/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:37,005 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0004/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:37,032 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0004/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:37,036 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:07:37,042 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000004 by user soberoi
2015-02-12 16:07:37,042 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:07:37,042 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0005
2015-02-12 16:07:37,043 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000004
2015-02-12 16:07:37,043 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0005 transitioned from NEW to INITING
2015-02-12 16:07:37,043 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000004 to application application_1423785972183_0005
2015-02-12 16:07:37,043 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0005 transitioned from INITING to RUNNING
2015-02-12 16:07:37,043 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 16:07:37,043 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:07:37,044 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0005
2015-02-12 16:07:37,044 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:07:37,044 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0005
2015-02-12 16:07:37,044 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:07:37,044 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:07:37,044 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0005_01_000004
2015-02-12 16:07:37,048 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000003 by user soberoi
2015-02-12 16:07:37,048 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000003
2015-02-12 16:07:37,048 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000003 to application application_1423785972183_0005
2015-02-12 16:07:37,049 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 16:07:37,049 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:07:37,049 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0005
2015-02-12 16:07:37,049 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:07:37,049 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0005
2015-02-12 16:07:37,050 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:07:37,070 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423785972183_0005_01_000004.tokens. Credentials list: 
2015-02-12 16:07:37,076 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:37,077 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:37,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:37,101 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:37,107 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 16:07:37,107 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:37,119 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:07:37,129 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0004_000001 (auth:SIMPLE)
2015-02-12 16:07:37,131 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0004_01_000005 by user soberoi
2015-02-12 16:07:37,131 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000005
2015-02-12 16:07:37,131 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0004_01_000005 to application application_1423785972183_0004
2015-02-12 16:07:37,132 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 16:07:37,132 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0004
2015-02-12 16:07:37,132 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0004
2015-02-12 16:07:37,132 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:07:37,132 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0004
2015-02-12 16:07:37,133 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0004_01_000005
2015-02-12 16:07:37,153 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0004/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:37,153 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:07:37,154 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:07:37,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:37,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:37,158 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423785972183_0004_01_000005.tokens. Credentials list: 
2015-02-12 16:07:37,194 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:07:37,195 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:07:37,195 INFO  fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423785972183_0004
2015-02-12 16:07:37,196 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000006 Container Transitioned from NEW to RESERVED
2015-02-12 16:07:37,196 INFO  fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423785972183_0004_01_000006 on node host: 10.1.1.67:60556 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@5dd29596
2015-02-12 16:07:37,213 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:07:37,224 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:07:37,224 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:07:37,225 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:37,225 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000007
2015-02-12 16:07:37,225 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0004_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 16:07:37,240 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0004/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:37,240 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:07:37,243 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 16:07:37,243 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:37,253 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 16:07:37,253 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:37,271 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000002 by user soberoi
2015-02-12 16:07:37,271 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0005
2015-02-12 16:07:37,272 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000002
2015-02-12 16:07:37,272 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0005 transitioned from NEW to INITING
2015-02-12 16:07:37,272 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000002 to application application_1423785972183_0005
2015-02-12 16:07:37,272 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0005 transitioned from INITING to RUNNING
2015-02-12 16:07:37,273 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 16:07:37,273 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:07:37,273 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0005
2015-02-12 16:07:37,273 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:07:37,273 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0005
2015-02-12 16:07:37,273 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:07:37,274 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:07:37,274 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0005_01_000002
2015-02-12 16:07:37,293 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423785972183_0005_01_000002.tokens. Credentials list: 
2015-02-12 16:07:37,311 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0004/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:37,311 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:07:37,380 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 16:07:37,380 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:37,442 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 16:07:37,442 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:37,453 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:07:37,453 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:37,454 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000006
2015-02-12 16:07:37,454 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 16:07:37,573 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000003/default_container_executor.sh]
2015-02-12 16:07:37,590 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:07:37,590 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60564 for container : container_1423785972183_0005_01_000006
2015-02-12 16:07:37,591 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:07:37,621 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:07:37,641 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:07:37,641 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:07:37,647 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000005 by user soberoi
2015-02-12 16:07:37,649 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000005
2015-02-12 16:07:37,649 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000005 to application application_1423785972183_0005
2015-02-12 16:07:37,650 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 16:07:37,650 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:07:37,650 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0005
2015-02-12 16:07:37,650 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:07:37,650 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0005
2015-02-12 16:07:37,651 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0005_01_000005
2015-02-12 16:07:37,651 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000006 by user soberoi
2015-02-12 16:07:37,652 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0005
2015-02-12 16:07:37,652 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000006
2015-02-12 16:07:37,652 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0005 transitioned from NEW to INITING
2015-02-12 16:07:37,653 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000006 to application application_1423785972183_0005
2015-02-12 16:07:37,653 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0005 transitioned from INITING to RUNNING
2015-02-12 16:07:37,653 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 16:07:37,653 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:07:37,653 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0005
2015-02-12 16:07:37,654 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:07:37,654 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0005
2015-02-12 16:07:37,654 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:07:37,654 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:07:37,654 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0005_01_000006
2015-02-12 16:07:37,679 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423785972183_0005_01_000005.tokens. Credentials list: 
2015-02-12 16:07:37,687 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423785972183_0005_01_000006.tokens. Credentials list: 
2015-02-12 16:07:37,701 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000005/default_container_executor.sh]
2015-02-12 16:07:37,742 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000003/default_container_executor.sh]
2015-02-12 16:07:37,788 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741863_1039
2015-02-12 16:07:37,789 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741864_1040
2015-02-12 16:07:37,789 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741866_1042
2015-02-12 16:07:37,790 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741868_1044
2015-02-12 16:07:37,791 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000004/default_container_executor.sh]
2015-02-12 16:07:37,866 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000002/default_container_executor.sh]
2015-02-12 16:07:37,939 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1423785972183_0005_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000002.tokens
2015-02-12 16:07:37,939 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:07:37,951 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:07:37,951 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:07:37,952 INFO  fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423785972183_0004
2015-02-12 16:07:37,952 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000008 Container Transitioned from NEW to RESERVED
2015-02-12 16:07:37,952 INFO  fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423785972183_0004_01_000008 on node host: 10.1.1.67:60560 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@5dd29596
2015-02-12 16:07:37,990 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741869_1045
2015-02-12 16:07:37,991 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741865_1041
2015-02-12 16:07:38,125 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:07:38,134 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0004_000001 (auth:SIMPLE)
2015-02-12 16:07:38,136 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0004_01_000007 by user soberoi
2015-02-12 16:07:38,136 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000007
2015-02-12 16:07:38,136 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0004_01_000007 to application application_1423785972183_0004
2015-02-12 16:07:38,137 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 16:07:38,137 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0004
2015-02-12 16:07:38,137 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0004
2015-02-12 16:07:38,137 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:07:38,137 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0004
2015-02-12 16:07:38,138 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:07:38,165 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:38,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:38,194 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 16:07:38,194 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:38,195 INFO  fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423785972183_0004_000001 on node host: 10.1.1.67:60556 #containers=3 available=0 used=4096
2015-02-12 16:07:38,196 INFO  fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423785972183_0004 unreserved  on node host: 10.1.1.67:60556 #containers=3 available=0 used=4096, currently has 1 at priority 20; currentReservation <memory:1024, vCores:1>
2015-02-12 16:07:38,196 INFO  fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423785972183_0004
2015-02-12 16:07:38,196 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000009 Container Transitioned from NEW to RESERVED
2015-02-12 16:07:38,196 INFO  fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423785972183_0004_01_000009 on node host: 10.1.1.67:60556 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@5dd29596
2015-02-12 16:07:38,202 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:07:38,230 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:07:38,231 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000010 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:38,231 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000010
2015-02-12 16:07:38,231 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0004_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 16:07:38,242 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0005/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:38,281 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:07:38,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:38,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:38,371 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0005/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:38,371 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:07:38,372 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:07:38,403 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423785972183_0005_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000006.tokens
2015-02-12 16:07:38,404 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:07:38,445 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 16:07:38,445 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:38,452 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000007/default_container_executor.sh]
2015-02-12 16:07:38,454 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:07:38,455 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:38,455 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000007
2015-02-12 16:07:38,455 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 16:07:38,455 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 16:07:38,456 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:38,505 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423785972183_0005_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000004.tokens
2015-02-12 16:07:38,505 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:07:38,601 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 16:07:38,601 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:07:38,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:38,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:38,761 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000005/default_container_executor.sh]
2015-02-12 16:07:38,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:38,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:07:38,790 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000002/default_container_executor.sh]
2015-02-12 16:07:38,827 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0005/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:38,852 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0005/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:38,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:38,881 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:38,884 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741862_1038
2015-02-12 16:07:38,954 INFO  fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423785972183_0004_000001 on node host: 10.1.1.67:60560 #containers=3 available=0 used=4096
2015-02-12 16:07:38,954 INFO  fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423785972183_0004 unreserved  on node host: 10.1.1.67:60560 #containers=3 available=0 used=4096, currently has 1 at priority 20; currentReservation <memory:1024, vCores:1>
2015-02-12 16:07:38,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:38,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:07:39,017 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0005/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:39,017 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:07:39,051 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0005/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:07:39,051 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:07:39,079 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 16:07:39,079 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:39,085 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741863_1039
2015-02-12 16:07:39,121 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 16:07:39,121 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:39,131 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 16:07:39,131 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000010 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:07:39,197 INFO  fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423785972183_0004_000001 on node host: 10.1.1.67:60556 #containers=3 available=0 used=4096
2015-02-12 16:07:39,197 INFO  fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423785972183_0004 unreserved  on node host: 10.1.1.67:60556 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 16:07:39,421 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000006/default_container_executor.sh]
2015-02-12 16:07:39,422 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:07:39,476 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000004/default_container_executor.sh]
2015-02-12 16:07:39,607 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000007 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:07:39,607 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000007 in state: RELEASED event:RELEASED
2015-02-12 16:07:39,607 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000007
2015-02-12 16:07:39,607 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 16:07:39,607 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000007 on node: host: 10.1.1.67:60564 #containers=3 available=1024 used=3072 with event: RELEASED
2015-02-12 16:07:39,609 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1423785972183_0005_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000005.tokens
2015-02-12 16:07:39,610 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:07:40,053 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:07:40,137 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000010 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:07:40,138 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0004_01_000010 in state: RELEASED event:RELEASED
2015-02-12 16:07:40,138 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000010
2015-02-12 16:07:40,140 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0004_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 16:07:40,140 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0004_000001 released container container_1423785972183_0004_01_000010 on node: host: 10.1.1.67:60568 #containers=3 available=1024 used=3072 with event: RELEASED
2015-02-12 16:07:40,201 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423785972183_0004_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000005.tokens
2015-02-12 16:07:40,203 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:07:40,241 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0004_01_000010
2015-02-12 16:07:40,459 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0005_01_000007
2015-02-12 16:07:42,998 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741872_1048
2015-02-12 16:07:42,999 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741873_1049
2015-02-12 16:07:43,382 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741870_1046
2015-02-12 16:07:43,382 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741871_1047
2015-02-12 16:07:43,383 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741872_1048
2015-02-12 16:07:43,605 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741871_1047
2015-02-12 16:07:43,606 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741873_1049
2015-02-12 16:07:43,607 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741870_1046
2015-02-12 16:07:44,093 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741870_1046
2015-02-12 16:07:44,094 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741872_1048
2015-02-12 16:07:44,095 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741873_1049
2015-02-12 16:07:44,095 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741871_1047
2015-02-12 16:07:56,684 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30010 milliseconds
2015-02-12 16:07:56,684 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 16:07:56,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:56,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:56,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:56,928 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:56,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:57,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:57,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:57,116 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:57,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:57,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:07:57,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:07:57,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:07:57,777 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:07:57,790 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:07:57,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:07:57,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:07:57,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:07:58,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:07:58,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:07:58,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:07:58,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_temporary/1/_temporary/attempt_1423785972183_0004_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 16:07:58,903 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0004_000001 (auth:SIMPLE)
2015-02-12 16:07:58,906 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0004_01_000003
2015-02-12 16:07:58,906 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000003
2015-02-12 16:07:58,906 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000003 transitioned from RUNNING to KILLING
2015-02-12 16:07:58,907 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0004_01_000003
2015-02-12 16:07:58,928 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job_1423785972183_0004_1.jhist. BP-2102022600-10.1.1.67-1423785955551 blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]}
2015-02-12 16:07:58,956 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741874_1050 src: /127.0.0.1:61033 dest: /127.0.0.1:60521
2015-02-12 16:07:58,960 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741874_1050 src: /127.0.0.1:61034 dest: /127.0.0.1:60515
2015-02-12 16:07:58,962 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741874_1050 src: /127.0.0.1:61035 dest: /127.0.0.1:60518
2015-02-12 16:07:58,962 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0004_01_000003 is : 143
2015-02-12 16:07:58,970 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job_1423785972183_0004_1.jhist for DFSClient_NONMAPREDUCE_115437968_1
2015-02-12 16:07:58,977 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:07:58,978 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000003
2015-02-12 16:07:58,978 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000003
2015-02-12 16:07:58,979 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000003
2015-02-12 16:07:58,979 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000003
2015-02-12 16:07:58,979 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000003
2015-02-12 16:07:58,980 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:07:58,981 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0004_01_000003 from application application_1423785972183_0004
2015-02-12 16:07:58,981 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:58,982 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0004
2015-02-12 16:07:59,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_temporary/1/_temporary/attempt_1423785972183_0004_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 16:07:59,145 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0004_000001 (auth:SIMPLE)
2015-02-12 16:07:59,147 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0004_01_000004
2015-02-12 16:07:59,147 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000004
2015-02-12 16:07:59,147 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000004 transitioned from RUNNING to KILLING
2015-02-12 16:07:59,147 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0004_01_000004
2015-02-12 16:07:59,167 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0004_01_000004 is : 143
2015-02-12 16:07:59,177 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:07:59,178 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000004
2015-02-12 16:07:59,180 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000004
2015-02-12 16:07:59,182 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000004
2015-02-12 16:07:59,182 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000004
2015-02-12 16:07:59,183 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000004
2015-02-12 16:07:59,183 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:07:59,183 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0004_01_000004 from application application_1423785972183_0004
2015-02-12 16:07:59,183 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:59,183 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0004
2015-02-12 16:07:59,222 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_temporary/1/_temporary/attempt_1423785972183_0004_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 16:07:59,246 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0004_000001 (auth:SIMPLE)
2015-02-12 16:07:59,248 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0004_01_000005
2015-02-12 16:07:59,248 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000005
2015-02-12 16:07:59,249 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000005 transitioned from RUNNING to KILLING
2015-02-12 16:07:59,249 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0004_01_000005
2015-02-12 16:07:59,250 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:07:59,250 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0004_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 16:07:59,250 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000004
2015-02-12 16:07:59,250 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0004_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 16:07:59,250 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0004_000001 released container container_1423785972183_0004_01_000004 on node: host: 10.1.1.67:60564 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 16:07:59,268 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0004_01_000005 is : 143
2015-02-12 16:07:59,282 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:07:59,286 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000005
2015-02-12 16:07:59,287 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000005
2015-02-12 16:07:59,288 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000005
2015-02-12 16:07:59,290 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000005
2015-02-12 16:07:59,291 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000005
2015-02-12 16:07:59,292 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:07:59,292 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0004_01_000005 from application application_1423785972183_0004
2015-02-12 16:07:59,292 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:59,293 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0004
2015-02-12 16:07:59,322 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:07:59,323 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000003
2015-02-12 16:07:59,324 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000003
2015-02-12 16:07:59,324 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000003 transitioned from RUNNING to KILLING
2015-02-12 16:07:59,324 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000003
2015-02-12 16:07:59,343 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0005_01_000003 is : 143
2015-02-12 16:07:59,349 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job_1423785972183_0005_1.jhist. BP-2102022600-10.1.1.67-1423785955551 blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]}
2015-02-12 16:07:59,352 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741875_1051 src: /127.0.0.1:61044 dest: /127.0.0.1:60521
2015-02-12 16:07:59,353 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741875_1051 src: /127.0.0.1:61045 dest: /127.0.0.1:60518
2015-02-12 16:07:59,355 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741875_1051 src: /127.0.0.1:61046 dest: /127.0.0.1:60515
2015-02-12 16:07:59,359 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job_1423785972183_0005_1.jhist for DFSClient_NONMAPREDUCE_-1318689195_1
2015-02-12 16:07:59,359 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:07:59,360 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000003
2015-02-12 16:07:59,362 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000003
2015-02-12 16:07:59,364 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000003
2015-02-12 16:07:59,364 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000003
2015-02-12 16:07:59,364 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000003
2015-02-12 16:07:59,365 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:07:59,366 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000003 from application application_1423785972183_0005
2015-02-12 16:07:59,366 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:59,366 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:07:59,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_temporary/1/_temporary/attempt_1423785972183_0004_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 16:07:59,468 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0004_000001 (auth:SIMPLE)
2015-02-12 16:07:59,470 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0004_01_000002
2015-02-12 16:07:59,470 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000002
2015-02-12 16:07:59,471 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:07:59,472 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 16:07:59,472 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000003
2015-02-12 16:07:59,472 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 16:07:59,472 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000003 on node: host: 10.1.1.67:60556 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 16:07:59,472 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000002 transitioned from RUNNING to KILLING
2015-02-12 16:07:59,473 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0004_01_000002
2015-02-12 16:07:59,505 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0004_01_000002 is : 143
2015-02-12 16:07:59,518 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:07:59,518 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000002
2015-02-12 16:07:59,519 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000002
2015-02-12 16:07:59,520 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000002
2015-02-12 16:07:59,521 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000002
2015-02-12 16:07:59,525 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000002
2015-02-12 16:07:59,525 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:07:59,525 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0004_01_000002 from application application_1423785972183_0004
2015-02-12 16:07:59,526 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:59,526 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0004
2015-02-12 16:07:59,576 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:07:59,578 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000005
2015-02-12 16:07:59,579 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000005
2015-02-12 16:07:59,579 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000005 transitioned from RUNNING to KILLING
2015-02-12 16:07:59,579 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000005
2015-02-12 16:07:59,601 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0005_01_000005 is : 143
2015-02-12 16:07:59,612 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:07:59,613 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000005
2015-02-12 16:07:59,616 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000005
2015-02-12 16:07:59,618 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000005
2015-02-12 16:07:59,619 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000005
2015-02-12 16:07:59,619 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000005
2015-02-12 16:07:59,621 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:07:59,621 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000005 from application application_1423785972183_0005
2015-02-12 16:07:59,621 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:59,622 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:07:59,713 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:07:59,717 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000002
2015-02-12 16:07:59,717 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000002
2015-02-12 16:07:59,718 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:07:59,719 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 16:07:59,719 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000005
2015-02-12 16:07:59,719 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 16:07:59,719 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000005 on node: host: 10.1.1.67:60560 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 16:07:59,720 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000002 transitioned from RUNNING to KILLING
2015-02-12 16:07:59,721 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000002
2015-02-12 16:07:59,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_temporary/1/_temporary/attempt_1423785972183_0004_m_000004_0	dst=null	perm=null	proto=rpc
2015-02-12 16:07:59,746 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0005_01_000002 is : 143
2015-02-12 16:07:59,757 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:07:59,758 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000002
2015-02-12 16:07:59,758 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000002
2015-02-12 16:07:59,759 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000002
2015-02-12 16:07:59,759 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000002
2015-02-12 16:07:59,760 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000002
2015-02-12 16:07:59,760 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:07:59,760 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000002 from application application_1423785972183_0005
2015-02-12 16:07:59,761 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:59,761 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:07:59,778 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0004_000001 (auth:SIMPLE)
2015-02-12 16:07:59,782 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0004_01_000007
2015-02-12 16:07:59,783 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000007
2015-02-12 16:07:59,784 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000007 transitioned from RUNNING to KILLING
2015-02-12 16:07:59,784 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0004_01_000007
2015-02-12 16:07:59,786 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:07:59,786 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0004_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 16:07:59,786 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000003
2015-02-12 16:07:59,786 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0004_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 16:07:59,786 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0004_000001 released container container_1423785972183_0004_01_000003 on node: host: 10.1.1.67:60568 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 16:07:59,786 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:59,787 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000008
2015-02-12 16:07:59,787 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 16:07:59,808 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0004_01_000007 is : 143
2015-02-12 16:07:59,816 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:07:59,817 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000007
2015-02-12 16:07:59,817 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000007
2015-02-12 16:07:59,818 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:07:59,818 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0004_01_000007 from application application_1423785972183_0004
2015-02-12 16:07:59,818 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:07:59,818 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0004
2015-02-12 16:07:59,818 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000007
2015-02-12 16:07:59,818 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000007
2015-02-12 16:07:59,819 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000007
2015-02-12 16:07:59,954 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3721187720_lower_A1877AA73DB348179CF770A6EF14E5AC/_temporary/1/_temporary/attempt_1423785972183_0005_m_000004_0	dst=null	perm=null	proto=rpc
2015-02-12 16:07:59,966 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:07:59,967 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000004
2015-02-12 16:07:59,968 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000004
2015-02-12 16:07:59,968 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000004 transitioned from RUNNING to KILLING
2015-02-12 16:07:59,968 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:59,969 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:07:59,969 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0004_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 16:07:59,969 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000007
2015-02-12 16:07:59,969 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000004
2015-02-12 16:07:59,969 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0004_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 16:07:59,970 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0004_000001 released container container_1423785972183_0004_01_000007 on node: host: 10.1.1.67:60568 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 16:07:59,970 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:59,970 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000009
2015-02-12 16:07:59,970 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 16:07:59,986 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:07:59,988 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000006
2015-02-12 16:07:59,988 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000006
2015-02-12 16:07:59,988 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000006 transitioned from RUNNING to KILLING
2015-02-12 16:07:59,988 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000006
2015-02-12 16:07:59,989 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:07:59,989 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:07:59,989 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0004_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 16:07:59,989 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000005
2015-02-12 16:07:59,989 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0004_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 16:07:59,989 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0004_000001 released container container_1423785972183_0004_01_000005 on node: host: 10.1.1.67:60564 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 16:07:59,990 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000010 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:07:59,990 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000010
2015-02-12 16:07:59,990 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 16:07:59,991 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0005_01_000004 is : 143
2015-02-12 16:08:00,012 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0005_01_000006 is : 143
2015-02-12 16:08:00,022 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:08:00,023 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000004
2015-02-12 16:08:00,024 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000004
2015-02-12 16:08:00,024 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000004
2015-02-12 16:08:00,025 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000004
2015-02-12 16:08:00,026 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:08:00,026 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000004
2015-02-12 16:08:00,027 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000006
2015-02-12 16:08:00,026 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000006
2015-02-12 16:08:00,028 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000006
2015-02-12 16:08:00,028 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:08:00,029 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000006
2015-02-12 16:08:00,029 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:08:00,028 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000006
2015-02-12 16:08:00,029 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000006 from application application_1423785972183_0005
2015-02-12 16:08:00,029 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:00,029 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:08:00,029 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000004 from application application_1423785972183_0005
2015-02-12 16:08:00,030 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:00,030 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:08:00,479 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:00,479 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0004_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 16:08:00,479 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000002
2015-02-12 16:08:00,479 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0004_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 16:08:00,480 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0004_000001 released container container_1423785972183_0004_01_000002 on node: host: 10.1.1.67:60556 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 16:08:00,480 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:00,480 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000011 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:00,481 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000011
2015-02-12 16:08:00,481 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0004_01_000011 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 16:08:00,722 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:00,722 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 16:08:00,723 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000002
2015-02-12 16:08:00,723 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 16:08:00,723 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000002 on node: host: 10.1.1.67:60560 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 16:08:00,723 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:00,744 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:00,744 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:00,745 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000010 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:00,764 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:00,764 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:00,770 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:00,772 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000008 by user soberoi
2015-02-12 16:08:00,772 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000008
2015-02-12 16:08:00,772 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000008 to application application_1423785972183_0005
2015-02-12 16:08:00,773 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 16:08:00,773 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:08:00,773 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0005
2015-02-12 16:08:00,773 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:00,773 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0005
2015-02-12 16:08:00,774 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:00,776 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000010 by user soberoi
2015-02-12 16:08:00,776 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000010
2015-02-12 16:08:00,777 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000010 to application application_1423785972183_0005
2015-02-12 16:08:00,778 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000010 transitioned from NEW to LOCALIZING
2015-02-12 16:08:00,778 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:08:00,778 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0005
2015-02-12 16:08:00,778 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:00,778 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0005
2015-02-12 16:08:00,779 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000010 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:00,781 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000009 by user soberoi
2015-02-12 16:08:00,781 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000009
2015-02-12 16:08:00,790 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000009 to application application_1423785972183_0005
2015-02-12 16:08:00,791 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000009 transitioned from NEW to LOCALIZING
2015-02-12 16:08:00,791 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:08:00,791 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0005
2015-02-12 16:08:00,791 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:00,791 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0005
2015-02-12 16:08:00,792 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000009 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:00,843 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:00,843 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:00,851 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000010 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:00,852 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:00,853 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000009 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:00,853 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:00,975 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:00,976 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000009 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:00,976 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:00,976 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:00,976 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:00,977 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 16:08:00,977 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000004
2015-02-12 16:08:00,977 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 16:08:00,977 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000004 on node: host: 10.1.1.67:60568 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 16:08:00,977 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000011 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:00,977 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000011
2015-02-12 16:08:00,978 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000011 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 16:08:00,990 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0004_01_000004]
2015-02-12 16:08:00,991 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000010 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:00,991 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:00,991 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:00,991 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:00,991 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 16:08:00,991 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000006
2015-02-12 16:08:00,992 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 16:08:00,992 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000006 on node: host: 10.1.1.67:60564 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 16:08:00,992 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000012 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:00,992 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000012
2015-02-12 16:08:00,992 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000012 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 16:08:01,011 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000008/default_container_executor.sh]
2015-02-12 16:08:01,022 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000009/default_container_executor.sh]
2015-02-12 16:08:01,023 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000010/default_container_executor.sh]
2015-02-12 16:08:01,280 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000011 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:01,301 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0004_000001 (auth:SIMPLE)
2015-02-12 16:08:01,304 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0004_01_000011 by user soberoi
2015-02-12 16:08:01,304 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000011
2015-02-12 16:08:01,304 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0004_01_000011 to application application_1423785972183_0004
2015-02-12 16:08:01,305 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000011 transitioned from NEW to LOCALIZING
2015-02-12 16:08:01,305 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0004
2015-02-12 16:08:01,305 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0004
2015-02-12 16:08:01,305 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:01,305 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0004
2015-02-12 16:08:01,306 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000011 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:01,369 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000011 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:01,369 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:01,483 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0005_01_000003]
2015-02-12 16:08:01,483 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000011 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:01,484 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:01,484 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:01,484 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000013 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:01,484 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000013
2015-02-12 16:08:01,484 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000013 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 16:08:01,546 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000011/default_container_executor.sh]
2015-02-12 16:08:01,724 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0005_01_000005]
2015-02-12 16:08:01,724 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:01,725 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:01,726 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000014 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:01,726 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000014
2015-02-12 16:08:01,726 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000014 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 16:08:01,749 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000011 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:01,750 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000012 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:01,750 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000013 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:01,750 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000014 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:01,758 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:01,761 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000011 by user soberoi
2015-02-12 16:08:01,761 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000011
2015-02-12 16:08:01,761 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000011 to application application_1423785972183_0005
2015-02-12 16:08:01,763 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000011 transitioned from NEW to LOCALIZING
2015-02-12 16:08:01,763 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:08:01,763 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0005
2015-02-12 16:08:01,763 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:01,764 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0005
2015-02-12 16:08:01,765 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000011 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:01,823 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000011 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:01,823 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:01,982 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0004_01_000007, container_1423785972183_0004_01_000003]
2015-02-12 16:08:01,982 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000011 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:01,983 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:01,983 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:01,983 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:01,983 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000015 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:01,983 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000015
2015-02-12 16:08:01,983 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000015 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 16:08:01,992 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0004_01_000005]
2015-02-12 16:08:01,992 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:01,992 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:01,993 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000016 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:01,994 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000016
2015-02-12 16:08:01,994 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000016 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 16:08:02,009 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000011/default_container_executor.sh]
2015-02-12 16:08:02,289 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 16:08:02,484 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0004_01_000002]
2015-02-12 16:08:02,484 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:02,732 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0005_01_000002]
2015-02-12 16:08:02,732 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:02,762 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000012 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:08:02,762 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000012 in state: RELEASED event:RELEASED
2015-02-12 16:08:02,762 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000012
2015-02-12 16:08:02,762 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000012 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 16:08:02,763 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000012 on node: host: 10.1.1.67:60564 #containers=2 available=2048 used=2048 with event: RELEASED
2015-02-12 16:08:02,763 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000013 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:08:02,763 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000013 in state: RELEASED event:RELEASED
2015-02-12 16:08:02,763 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000013
2015-02-12 16:08:02,764 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000013 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 16:08:02,764 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000013 on node: host: 10.1.1.67:60556 #containers=2 available=1024 used=3072 with event: RELEASED
2015-02-12 16:08:02,764 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000014 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:08:02,764 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000014 in state: RELEASED event:RELEASED
2015-02-12 16:08:02,764 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000014
2015-02-12 16:08:02,765 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000014 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 16:08:02,765 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000014 on node: host: 10.1.1.67:60560 #containers=1 available=2048 used=2048 with event: RELEASED
2015-02-12 16:08:02,765 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 16:08:02,765 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000015 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:02,766 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000016 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:02,779 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:02,782 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000016 by user soberoi
2015-02-12 16:08:02,782 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000016
2015-02-12 16:08:02,782 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000016 to application application_1423785972183_0005
2015-02-12 16:08:02,782 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000016 transitioned from NEW to LOCALIZING
2015-02-12 16:08:02,782 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:08:02,783 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0005
2015-02-12 16:08:02,783 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:02,783 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0005
2015-02-12 16:08:02,783 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000016 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:02,846 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000016 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:02,846 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:02,989 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0005_01_000004]
2015-02-12 16:08:02,989 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:02,993 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0005_01_000006]
2015-02-12 16:08:02,994 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000016 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:02,994 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0005_01_000012
2015-02-12 16:08:02,994 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:03,022 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000016/default_container_executor.sh]
2015-02-12 16:08:03,491 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0005_01_000013
2015-02-12 16:08:03,737 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0005_01_000014
2015-02-12 16:08:03,772 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000015 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:08:03,773 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000015 in state: RELEASED event:RELEASED
2015-02-12 16:08:03,773 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000015
2015-02-12 16:08:03,773 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000015 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 16:08:03,773 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000015 on node: host: 10.1.1.67:60568 #containers=3 available=1024 used=3072 with event: RELEASED
2015-02-12 16:08:03,774 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 16:08:03,992 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0005_01_000015
2015-02-12 16:08:12,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:12,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:12,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:13,109 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 16:08:13,113 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 16:08:13,155 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 16:08:13,229 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:08:13,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:08:13,276 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:08:13,522 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:13,959 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(690)) - Number of transactions: 418 Total time for transactions(ms): 41 Number of transactions batched in Syncs: 3 Number of syncs: 271 SyncTimes(ms): 95 68 
2015-02-12 16:08:13,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_temporary/1/_temporary/attempt_1423785972183_0004_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:08:14,093 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:14,095 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000010
2015-02-12 16:08:14,095 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000010
2015-02-12 16:08:14,095 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000010 transitioned from RUNNING to KILLING
2015-02-12 16:08:14,095 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000010
2015-02-12 16:08:14,115 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0005_01_000010 is : 143
2015-02-12 16:08:14,126 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000010 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:08:14,127 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000010
2015-02-12 16:08:14,128 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000010
2015-02-12 16:08:14,129 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000010
2015-02-12 16:08:14,130 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000010
2015-02-12 16:08:14,132 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000010
2015-02-12 16:08:14,134 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000010 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:08:14,134 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000010 from application application_1423785972183_0005
2015-02-12 16:08:14,135 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:14,135 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:08:14,182 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:14,184 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000008
2015-02-12 16:08:14,184 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000008
2015-02-12 16:08:14,185 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000008 transitioned from RUNNING to KILLING
2015-02-12 16:08:14,185 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000008
2015-02-12 16:08:14,212 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0005_01_000008 is : 143
2015-02-12 16:08:14,229 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:08:14,230 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000008
2015-02-12 16:08:14,231 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000008
2015-02-12 16:08:14,232 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000008
2015-02-12 16:08:14,232 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000008
2015-02-12 16:08:14,233 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000008
2015-02-12 16:08:14,234 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:08:14,234 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000008 from application application_1423785972183_0005
2015-02-12 16:08:14,235 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:14,235 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:08:14,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,265 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:14,267 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000009
2015-02-12 16:08:14,267 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000009
2015-02-12 16:08:14,268 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000009 transitioned from RUNNING to KILLING
2015-02-12 16:08:14,268 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000009
2015-02-12 16:08:14,268 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:14,268 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 16:08:14,269 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000008
2015-02-12 16:08:14,269 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 16:08:14,269 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000008 on node: host: 10.1.1.67:60568 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 16:08:14,286 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_temporary/1/_temporary/attempt_1423785972183_0004_r_000000_0/part-00000. BP-2102022600-10.1.1.67-1423785955551 blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:08:14,292 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0005_01_000009 is : 143
2015-02-12 16:08:14,315 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000009 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:08:14,316 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000009
2015-02-12 16:08:14,316 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000009
2015-02-12 16:08:14,316 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000009
2015-02-12 16:08:14,317 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000009
2015-02-12 16:08:14,318 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000009
2015-02-12 16:08:14,318 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000009 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:08:14,319 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000009 from application application_1423785972183_0005
2015-02-12 16:08:14,319 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:14,319 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:08:14,501 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741876_1052 src: /127.0.0.1:61104 dest: /127.0.0.1:60521
2015-02-12 16:08:14,503 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741876_1052 src: /127.0.0.1:61105 dest: /127.0.0.1:60515
2015-02-12 16:08:14,504 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741876_1052 src: /127.0.0.1:61106 dest: /127.0.0.1:60511
2015-02-12 16:08:14,560 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61106, dest: /127.0.0.1:60511, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1423785972183_0004_r_000000_0_-1879067424_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741876_1052, duration: 54101000
2015-02-12 16:08:14,560 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741876_1052, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:14,561 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:14,561 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61105, dest: /127.0.0.1:60515, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1423785972183_0004_r_000000_0_-1879067424_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741876_1052, duration: 54824000
2015-02-12 16:08:14,561 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741876_1052, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:14,561 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:14,562 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61104, dest: /127.0.0.1:60521, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1423785972183_0004_r_000000_0_-1879067424_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741876_1052, duration: 55663000
2015-02-12 16:08:14,562 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741876_1052, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:14,562 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:14,566 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_temporary/1/_temporary/attempt_1423785972183_0004_r_000000_0/part-00000 is closed by DFSClient_attempt_1423785972183_0004_r_000000_0_-1879067424_1
2015-02-12 16:08:14,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_temporary/1/_temporary/attempt_1423785972183_0004_r_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_temporary/1/_temporary/attempt_1423785972183_0004_r_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_temporary/1/task_1423785972183_0004_r_000000	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_temporary/1/_temporary/attempt_1423785972183_0004_r_000000_0	dst=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_temporary/1/task_1423785972183_0004_r_000000	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 16:08:14,616 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0004_000001 (auth:SIMPLE)
2015-02-12 16:08:14,618 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0004_01_000011
2015-02-12 16:08:14,619 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000011
2015-02-12 16:08:14,620 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000011 transitioned from RUNNING to KILLING
2015-02-12 16:08:14,620 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0004_01_000011
2015-02-12 16:08:14,648 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0004_01_000011 is : 143
2015-02-12 16:08:14,648 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:08:14,653 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_115437968_1
2015-02-12 16:08:14,661 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_temporary/1	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,669 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,671 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_temporary/1/task_1423785972183_0004_r_000000	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,672 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/part-00000	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,673 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000011 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:08:14,674 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000011
2015-02-12 16:08:14,674 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000011
2015-02-12 16:08:14,676 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000011
2015-02-12 16:08:14,676 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_temporary/1/task_1423785972183_0004_r_000000/part-00000	dst=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/part-00000	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:08:14,677 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000011
2015-02-12 16:08:14,678 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000011
2015-02-12 16:08:14,679 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000011 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:08:14,680 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0004_01_000011 from application application_1423785972183_0004
2015-02-12 16:08:14,680 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:14,681 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0004
2015-02-12 16:08:14,682 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:08:14,691 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-soberoi/3084420364_upper_9D4036AE086A45A28CB6E8A3B738F17A/_SUCCESS is closed by DFSClient_NONMAPREDUCE_115437968_1
2015-02-12 16:08:14,695 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:08:14,698 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_115437968_1
2015-02-12 16:08:14,722 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61035, dest: /127.0.0.1:60518, bytes: 68430, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_115437968_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741874_1050, duration: 15758054000
2015-02-12 16:08:14,722 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741874_1050, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:14,723 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]} size 16338
2015-02-12 16:08:14,724 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61034, dest: /127.0.0.1:60515, bytes: 68430, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_115437968_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741874_1050, duration: 15759529000
2015-02-12 16:08:14,724 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741874_1050, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:14,725 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]} size 16338
2015-02-12 16:08:14,725 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61033, dest: /127.0.0.1:60521, bytes: 68430, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_115437968_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741874_1050, duration: 15761201000
2015-02-12 16:08:14,726 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741874_1050, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:14,727 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]} size 16338
2015-02-12 16:08:14,730 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job_1423785972183_0004_1.jhist is closed by DFSClient_NONMAPREDUCE_115437968_1
2015-02-12 16:08:14,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:08:14,735 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004.summary_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]}
2015-02-12 16:08:14,738 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741877_1053 src: /127.0.0.1:61109 dest: /127.0.0.1:60521
2015-02-12 16:08:14,739 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741877_1053 src: /127.0.0.1:61110 dest: /127.0.0.1:60511
2015-02-12 16:08:14,741 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741877_1053 src: /127.0.0.1:61111 dest: /127.0.0.1:60518
2015-02-12 16:08:14,745 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61111, dest: /127.0.0.1:60518, bytes: 428, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_115437968_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741877_1053, duration: 1966000
2015-02-12 16:08:14,745 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741877_1053, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:14,746 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]} size 0
2015-02-12 16:08:14,746 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61110, dest: /127.0.0.1:60511, bytes: 428, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_115437968_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741877_1053, duration: 3142000
2015-02-12 16:08:14,746 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741877_1053, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:14,747 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61109, dest: /127.0.0.1:60521, bytes: 428, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_115437968_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741877_1053, duration: 4298000
2015-02-12 16:08:14,748 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741877_1053, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:14,749 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:14,750 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:14,753 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004.summary_tmp is closed by DFSClient_NONMAPREDUCE_115437968_1
2015-02-12 16:08:14,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:08:14,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job_1423785972183_0004_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,771 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004-1423786047731-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F23BFE31346BC4224-1423786094701-5-1-SUCCEEDED-root.soberoi-1423786054072.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job_1423785972183_0004_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004-1423786047731-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F23BFE31346BC4224-1423786094701-5-1-SUCCEEDED-root.soberoi-1423786054072.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job_1423785972183_0004_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004-1423786047731-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F23BFE31346BC4224-1423786094701-5-1-SUCCEEDED-root.soberoi-1423786054072.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:08:14,793 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004-1423786047731-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F23BFE31346BC4224-1423786094701-5-1-SUCCEEDED-root.soberoi-1423786054072.jhist_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]}
2015-02-12 16:08:14,795 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741878_1054 src: /127.0.0.1:61113 dest: /127.0.0.1:60515
2015-02-12 16:08:14,797 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741878_1054 src: /127.0.0.1:61114 dest: /127.0.0.1:60518
2015-02-12 16:08:14,798 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741878_1054 src: /127.0.0.1:61115 dest: /127.0.0.1:60511
2015-02-12 16:08:14,802 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61115, dest: /127.0.0.1:60511, bytes: 68430, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_115437968_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741878_1054, duration: 2019000
2015-02-12 16:08:14,802 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741878_1054, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:14,803 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61114, dest: /127.0.0.1:60518, bytes: 68430, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_115437968_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741878_1054, duration: 3033000
2015-02-12 16:08:14,803 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]} size 0
2015-02-12 16:08:14,804 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61113, dest: /127.0.0.1:60515, bytes: 68430, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_115437968_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741878_1054, duration: 4412000
2015-02-12 16:08:14,805 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741878_1054, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:14,803 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741878_1054, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:14,806 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:14,807 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741878_1054 size 68430
2015-02-12 16:08:14,807 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004-1423786047731-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F23BFE31346BC4224-1423786094701-5-1-SUCCEEDED-root.soberoi-1423786054072.jhist_tmp is closed by DFSClient_NONMAPREDUCE_115437968_1
2015-02-12 16:08:14,811 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004-1423786047731-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F23BFE31346BC4224-1423786094701-5-1-SUCCEEDED-root.soberoi-1423786054072.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:08:14,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job_1423785972183_0004_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,813 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job_1423785972183_0004_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004/job_1423785972183_0004_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:14,822 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:08:14,828 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004_conf.xml_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]}
2015-02-12 16:08:14,832 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741879_1055 src: /127.0.0.1:61116 dest: /127.0.0.1:60515
2015-02-12 16:08:14,834 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741879_1055 src: /127.0.0.1:61117 dest: /127.0.0.1:60518
2015-02-12 16:08:14,836 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741879_1055 src: /127.0.0.1:61118 dest: /127.0.0.1:60511
2015-02-12 16:08:14,842 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61118, dest: /127.0.0.1:60511, bytes: 113219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_115437968_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741879_1055, duration: 2436000
2015-02-12 16:08:14,842 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741879_1055, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:14,844 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61117, dest: /127.0.0.1:60518, bytes: 113219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_115437968_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741879_1055, duration: 4713000
2015-02-12 16:08:14,844 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741879_1055, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:14,845 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:14,846 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61116, dest: /127.0.0.1:60515, bytes: 113219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_115437968_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741879_1055, duration: 7331000
2015-02-12 16:08:14,846 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741879_1055, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:14,847 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:14,849 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741879_1055 size 113219
2015-02-12 16:08:14,849 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_115437968_1
2015-02-12 16:08:14,851 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:08:14,854 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:08:14,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:08:14,860 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004-1423786047731-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F23BFE31346BC4224-1423786094701-5-1-SUCCEEDED-root.soberoi-1423786054072.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004-1423786047731-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F23BFE31346BC4224-1423786094701-5-1-SUCCEEDED-root.soberoi-1423786054072.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:08:14,873 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423785972183_0004_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 16:08:14,873 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0004_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 16:08:14,873 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423785972183_0004 with final state: FINISHING
2015-02-12 16:08:14,873 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0004 State change from RUNNING to FINAL_SAVING
2015-02-12 16:08:14,873 INFO  recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423785972183_0004
2015-02-12 16:08:14,875 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0004_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 16:08:14,875 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0004 State change from FINAL_SAVING to FINISHING
2015-02-12 16:08:14,993 INFO  mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(900)) - Setting connection close header...
2015-02-12 16:08:15,103 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000010 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:15,104 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000010 in state: COMPLETED event:FINISHED
2015-02-12 16:08:15,104 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000010
2015-02-12 16:08:15,104 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 16:08:15,104 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000010 on node: host: 10.1.1.67:60564 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 16:08:15,104 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000017 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:15,105 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000017
2015-02-12 16:08:15,105 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000017 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 16:08:15,122 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:15,123 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000011
2015-02-12 16:08:15,124 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000011
2015-02-12 16:08:15,124 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000011 transitioned from RUNNING to KILLING
2015-02-12 16:08:15,124 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000011
2015-02-12 16:08:15,124 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:15,125 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000009 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:15,125 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000009 in state: COMPLETED event:FINISHED
2015-02-12 16:08:15,125 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000009
2015-02-12 16:08:15,125 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 16:08:15,125 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000009 on node: host: 10.1.1.67:60568 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 16:08:15,126 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000018 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:15,126 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000018
2015-02-12 16:08:15,126 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000018 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 16:08:15,140 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0005_01_000011 is : 143
2015-02-12 16:08:15,152 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000011 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:08:15,153 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000011
2015-02-12 16:08:15,153 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000011
2015-02-12 16:08:15,155 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000011
2015-02-12 16:08:15,156 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000011
2015-02-12 16:08:15,156 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000011
2015-02-12 16:08:15,156 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000011 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:08:15,157 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000011 from application application_1423785972183_0005
2015-02-12 16:08:15,157 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:15,157 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:08:15,626 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000011 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:15,626 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0004_01_000011 in state: COMPLETED event:FINISHED
2015-02-12 16:08:15,626 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000011
2015-02-12 16:08:15,626 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0004_01_000011 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 16:08:15,626 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0004_000001 released container container_1423785972183_0004_01_000011 on node: host: 10.1.1.67:60556 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 16:08:15,627 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000019 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:15,627 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000019
2015-02-12 16:08:15,627 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000019 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 16:08:15,834 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000017 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:15,834 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000018 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:15,834 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000019 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:15,847 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:15,847 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:15,848 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:15,850 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000018 by user soberoi
2015-02-12 16:08:15,850 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000019 by user soberoi
2015-02-12 16:08:15,850 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000018
2015-02-12 16:08:15,850 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000018 to application application_1423785972183_0005
2015-02-12 16:08:15,851 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000018 transitioned from NEW to LOCALIZING
2015-02-12 16:08:15,851 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:08:15,851 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0005
2015-02-12 16:08:15,851 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:15,851 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0005
2015-02-12 16:08:15,851 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000019 to application application_1423785972183_0005
2015-02-12 16:08:15,852 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000019 transitioned from NEW to LOCALIZING
2015-02-12 16:08:15,852 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:08:15,852 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0005
2015-02-12 16:08:15,852 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:15,852 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0005
2015-02-12 16:08:15,853 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000019 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:15,850 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000019
2015-02-12 16:08:15,854 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000018 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:15,855 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000017 by user soberoi
2015-02-12 16:08:15,855 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000017
2015-02-12 16:08:15,864 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000017 to application application_1423785972183_0005
2015-02-12 16:08:15,864 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000017 transitioned from NEW to LOCALIZING
2015-02-12 16:08:15,865 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:08:15,865 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0005
2015-02-12 16:08:15,865 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:15,865 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0005
2015-02-12 16:08:15,865 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000017 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:15,903 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423785972183_0004 unregistered successfully. 
2015-02-12 16:08:15,910 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741862_1038 127.0.0.1:60511 127.0.0.1:60518 127.0.0.1:60515 127.0.0.1:60521 
2015-02-12 16:08:15,910 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741864_1040 127.0.0.1:60518 127.0.0.1:60511 127.0.0.1:60515 127.0.0.1:60521 
2015-02-12 16:08:15,911 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741866_1042 127.0.0.1:60518 127.0.0.1:60511 127.0.0.1:60515 
2015-02-12 16:08:15,912 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741868_1044 127.0.0.1:60515 127.0.0.1:60521 127.0.0.1:60511 
2015-02-12 16:08:15,912 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741871_1047 127.0.0.1:60511 127.0.0.1:60521 127.0.0.1:60518 
2015-02-12 16:08:15,912 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741874_1050 127.0.0.1:60521 127.0.0.1:60515 127.0.0.1:60518 
2015-02-12 16:08:15,913 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741870_1046 127.0.0.1:60511 127.0.0.1:60521 127.0.0.1:60518 
2015-02-12 16:08:15,913 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0004	dst=null	perm=null	proto=rpc
2015-02-12 16:08:15,953 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000019 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:15,953 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:15,953 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000018 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:15,953 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:15,964 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000017 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:15,964 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:16,109 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000017 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:16,109 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:16,110 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000020 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:16,110 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000020
2015-02-12 16:08:16,110 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000020 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 16:08:16,131 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0005_01_000008]
2015-02-12 16:08:16,132 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000018 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:16,132 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:16,132 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:16,132 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000011 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:16,132 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000011 in state: COMPLETED event:FINISHED
2015-02-12 16:08:16,132 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000011
2015-02-12 16:08:16,132 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000011 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 16:08:16,132 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000011 on node: host: 10.1.1.67:60568 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 16:08:16,133 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000021 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:16,133 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000021
2015-02-12 16:08:16,133 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000021 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 16:08:16,144 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000019/default_container_executor.sh]
2015-02-12 16:08:16,146 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000018/default_container_executor.sh]
2015-02-12 16:08:16,153 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000017/default_container_executor.sh]
2015-02-12 16:08:16,635 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000019 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:16,636 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:16,636 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000022 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:16,636 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000022
2015-02-12 16:08:16,636 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000022 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 16:08:16,805 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000023 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:16,805 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000023
2015-02-12 16:08:16,805 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000023 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 16:08:16,843 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000020 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:16,844 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000021 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:16,844 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000022 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:16,845 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000023 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:16,854 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:16,857 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000020 by user soberoi
2015-02-12 16:08:16,857 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000020
2015-02-12 16:08:16,858 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000020 to application application_1423785972183_0005
2015-02-12 16:08:16,858 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000020 transitioned from NEW to LOCALIZING
2015-02-12 16:08:16,858 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:08:16,858 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0005
2015-02-12 16:08:16,858 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:16,858 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0005
2015-02-12 16:08:16,859 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000020 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:16,917 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000020 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:16,917 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:17,106 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000020/default_container_executor.sh]
2015-02-12 16:08:17,116 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0005_01_000010]
2015-02-12 16:08:17,117 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000020 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:17,117 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:17,117 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000024 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:17,117 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000024
2015-02-12 16:08:17,117 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000024 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 16:08:17,142 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0005_01_000009]
2015-02-12 16:08:17,142 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:17,143 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:17,643 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:17,819 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60521 to delete [blk_1073741874_1050, blk_1073741862_1038, blk_1073741864_1040, blk_1073741868_1044, blk_1073741870_1046, blk_1073741871_1047]
2015-02-12 16:08:17,819 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60515 to delete [blk_1073741874_1050, blk_1073741862_1038, blk_1073741864_1040, blk_1073741866_1042, blk_1073741868_1044]
2015-02-12 16:08:17,856 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000021 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:08:17,856 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000021 in state: RELEASED event:RELEASED
2015-02-12 16:08:17,856 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000021
2015-02-12 16:08:17,857 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000021 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 16:08:17,857 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000021 on node: host: 10.1.1.67:60568 #containers=1 available=3072 used=1024 with event: RELEASED
2015-02-12 16:08:17,857 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000022 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:08:17,857 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000022 in state: RELEASED event:RELEASED
2015-02-12 16:08:17,857 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000022
2015-02-12 16:08:17,858 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000022 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 16:08:17,858 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000022 on node: host: 10.1.1.67:60556 #containers=2 available=1024 used=3072 with event: RELEASED
2015-02-12 16:08:17,858 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000023 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:08:17,858 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000023 in state: RELEASED event:RELEASED
2015-02-12 16:08:17,858 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000023
2015-02-12 16:08:17,858 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000023 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 16:08:17,858 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000023 on node: host: 10.1.1.67:60560 #containers=1 available=2048 used=2048 with event: RELEASED
2015-02-12 16:08:17,858 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 16:08:17,859 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000024 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:18,146 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0005_01_000011]
2015-02-12 16:08:18,146 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:18,146 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0005_01_000021
2015-02-12 16:08:18,651 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0005_01_000022
2015-02-12 16:08:18,651 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:18,688 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741874 for deletion
2015-02-12 16:08:18,688 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741862 for deletion
2015-02-12 16:08:18,689 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741864 for deletion
2015-02-12 16:08:18,689 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741874
2015-02-12 16:08:18,689 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741866 for deletion
2015-02-12 16:08:18,689 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741868 for deletion
2015-02-12 16:08:18,689 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741862
2015-02-12 16:08:18,690 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741868
2015-02-12 16:08:18,690 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741864
2015-02-12 16:08:18,690 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741866
2015-02-12 16:08:18,816 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0005_01_000023
2015-02-12 16:08:18,865 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000024 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:08:18,865 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000024 in state: RELEASED event:RELEASED
2015-02-12 16:08:18,865 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000024
2015-02-12 16:08:18,865 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000024 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 16:08:18,865 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000024 on node: host: 10.1.1.67:60564 #containers=3 available=1024 used=3072 with event: RELEASED
2015-02-12 16:08:19,130 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0005_01_000024
2015-02-12 16:08:19,357 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741874 for deletion
2015-02-12 16:08:19,358 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741862 for deletion
2015-02-12 16:08:19,358 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741864 for deletion
2015-02-12 16:08:19,358 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741868 for deletion
2015-02-12 16:08:19,358 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741874
2015-02-12 16:08:19,358 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741862
2015-02-12 16:08:19,358 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741870 for deletion
2015-02-12 16:08:19,358 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741864
2015-02-12 16:08:19,358 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741868
2015-02-12 16:08:19,358 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741871 for deletion
2015-02-12 16:08:19,359 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741870
2015-02-12 16:08:19,359 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741871
2015-02-12 16:08:19,660 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:20,662 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:20,820 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60518 to delete [blk_1073741874_1050, blk_1073741862_1038, blk_1073741864_1040, blk_1073741866_1042, blk_1073741870_1046, blk_1073741871_1047]
2015-02-12 16:08:20,820 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60511 to delete [blk_1073741862_1038, blk_1073741864_1040, blk_1073741866_1042, blk_1073741868_1044, blk_1073741870_1046, blk_1073741871_1047]
2015-02-12 16:08:20,999 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423785972183_0004_01_000001 succeeded 
2015-02-12 16:08:20,999 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 16:08:20,999 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0004_01_000001
2015-02-12 16:08:21,020 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000001
2015-02-12 16:08:21,021 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000001
2015-02-12 16:08:21,021 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000001
2015-02-12 16:08:21,022 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0004/container_1423785972183_0004_01_000001
2015-02-12 16:08:21,023 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000001
2015-02-12 16:08:21,023 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0004_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 16:08:21,023 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0004_01_000001 from application application_1423785972183_0004
2015-02-12 16:08:21,024 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:21,024 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0004
2015-02-12 16:08:21,668 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:21,689 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741862 for deletion
2015-02-12 16:08:21,689 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741864 for deletion
2015-02-12 16:08:21,689 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741866 for deletion
2015-02-12 16:08:21,690 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741868 for deletion
2015-02-12 16:08:21,690 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741862
2015-02-12 16:08:21,690 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741870 for deletion
2015-02-12 16:08:21,690 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741871 for deletion
2015-02-12 16:08:21,690 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741864
2015-02-12 16:08:21,690 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741871
2015-02-12 16:08:21,690 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741866
2015-02-12 16:08:21,691 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741868
2015-02-12 16:08:21,691 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741870
2015-02-12 16:08:21,822 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0004_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:21,822 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423785972183_0004_000001
2015-02-12 16:08:21,822 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423785972183_0004_000001
2015-02-12 16:08:21,822 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0004_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 16:08:21,823 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0004_000001 State change from FINISHING to FINISHED
2015-02-12 16:08:21,823 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0004 State change from FINISHING to FINISHED
2015-02-12 16:08:21,823 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000001
2015-02-12 16:08:21,823 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0004_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:60560, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 16:08:21,823 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0004_000001 released container container_1423785972183_0004_01_000001 on node: host: 10.1.1.67:60560 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 16:08:21,823 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1423785972183_0004
2015-02-12 16:08:21,824 INFO  amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423785972183_0004_000001
2015-02-12 16:08:21,824 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423785972183_0004,name=[2404B61D06B64A69A6AC8C117644964F/23BFE31346BC4224B862780BCCEF5943] lower*upper/(1/3),user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:60554/proxy/application_1423785972183_0004/jobhistory/job/job_1423785972183_0004,appMasterHost=10.1.1.67,startTime=1423786047731,finishTime=1423786094873,finalStatus=SUCCEEDED
2015-02-12 16:08:21,824 INFO  fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423785972183_0004_000001 is done. finalState=FINISHED
2015-02-12 16:08:21,824 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423785972183_0004 requests cleared
2015-02-12 16:08:21,827 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0004_000001 (auth:SIMPLE)
2015-02-12 16:08:21,829 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0004_01_000001
2015-02-12 16:08:21,829 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0004	CONTAINERID=container_1423785972183_0004_01_000001
2015-02-12 16:08:21,830 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0004_01_000001]
2015-02-12 16:08:21,830 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:21,830 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:08:21,830 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:08:21,831 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:08:21,831 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:08:21,831 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0004
2015-02-12 16:08:21,831 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:08:21,831 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0004, with delay of 10800 seconds
2015-02-12 16:08:21,832 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:08:22,075 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741874 for deletion
2015-02-12 16:08:22,075 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741862 for deletion
2015-02-12 16:08:22,076 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741864 for deletion
2015-02-12 16:08:22,076 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741874
2015-02-12 16:08:22,076 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741862
2015-02-12 16:08:22,076 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741866 for deletion
2015-02-12 16:08:22,076 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741870 for deletion
2015-02-12 16:08:22,076 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741864
2015-02-12 16:08:22,076 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741871 for deletion
2015-02-12 16:08:22,077 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741866
2015-02-12 16:08:22,077 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741870
2015-02-12 16:08:22,077 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741871
2015-02-12 16:08:22,142 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:08:22,142 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:08:22,143 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:08:22,143 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:08:22,143 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0004
2015-02-12 16:08:22,144 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:08:22,144 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0004, with delay of 10800 seconds
2015-02-12 16:08:22,143 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:08:22,164 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:08:22,165 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:08:22,165 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:08:22,165 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0004
2015-02-12 16:08:22,165 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:08:22,165 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0004, with delay of 10800 seconds
2015-02-12 16:08:22,166 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:08:22,166 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:08:22,675 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:08:22,675 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:22,675 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:08:22,676 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:08:22,676 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:08:22,676 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0004
2015-02-12 16:08:22,676 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0004
2015-02-12 16:08:22,676 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:08:22,676 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0004, with delay of 10800 seconds
2015-02-12 16:08:23,031 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741878_1054
2015-02-12 16:08:23,032 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741879_1055
2015-02-12 16:08:23,033 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741876_1052
2015-02-12 16:08:23,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:23,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:23,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:23,435 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741879_1055
2015-02-12 16:08:23,436 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741876_1052
2015-02-12 16:08:23,437 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741877_1053
2015-02-12 16:08:23,438 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741878_1054
2015-02-12 16:08:23,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:08:23,659 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741877_1053
2015-02-12 16:08:23,660 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741879_1055
2015-02-12 16:08:23,661 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741878_1054
2015-02-12 16:08:23,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:08:23,681 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:23,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:08:24,140 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741877_1053
2015-02-12 16:08:24,140 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741876_1052
2015-02-12 16:08:24,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:24,282 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:24,283 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000017
2015-02-12 16:08:24,284 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000017
2015-02-12 16:08:24,284 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000017 transitioned from RUNNING to KILLING
2015-02-12 16:08:24,284 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000017
2015-02-12 16:08:24,303 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0005_01_000017 is : 143
2015-02-12 16:08:24,316 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000017 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:08:24,317 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000017
2015-02-12 16:08:24,318 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000017
2015-02-12 16:08:24,320 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000017
2015-02-12 16:08:24,322 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000017
2015-02-12 16:08:24,324 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000017
2015-02-12 16:08:24,324 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000017 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:08:24,324 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000017 from application application_1423785972183_0005
2015-02-12 16:08:24,324 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:24,325 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:08:24,417 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:24,419 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000018
2015-02-12 16:08:24,419 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000018
2015-02-12 16:08:24,419 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000018 transitioned from RUNNING to KILLING
2015-02-12 16:08:24,419 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000018
2015-02-12 16:08:24,441 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:24,441 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0005_01_000018 is : 143
2015-02-12 16:08:24,443 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000019
2015-02-12 16:08:24,443 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000019
2015-02-12 16:08:24,444 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000019 transitioned from RUNNING to KILLING
2015-02-12 16:08:24,444 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000019
2015-02-12 16:08:24,451 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000018 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:08:24,453 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000018
2015-02-12 16:08:24,453 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000018
2015-02-12 16:08:24,453 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000018 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:08:24,454 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000018
2015-02-12 16:08:24,454 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000018
2015-02-12 16:08:24,455 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000018
2015-02-12 16:08:24,454 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000018 from application application_1423785972183_0005
2015-02-12 16:08:24,456 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:24,457 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:08:24,475 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0005_01_000019 is : 143
2015-02-12 16:08:24,487 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000019 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:08:24,489 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000019
2015-02-12 16:08:24,491 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000019
2015-02-12 16:08:24,494 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000019
2015-02-12 16:08:24,494 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000019
2015-02-12 16:08:24,494 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000019
2015-02-12 16:08:24,495 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000019 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:08:24,495 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000019 from application application_1423785972183_0005
2015-02-12 16:08:24,495 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:24,495 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:08:24,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:08:24,926 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:24,928 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000020
2015-02-12 16:08:24,928 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000020
2015-02-12 16:08:24,928 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000020 transitioned from RUNNING to KILLING
2015-02-12 16:08:24,928 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000020
2015-02-12 16:08:24,929 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000017 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:24,930 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000017 in state: COMPLETED event:FINISHED
2015-02-12 16:08:24,930 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000017
2015-02-12 16:08:24,930 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000017 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 16:08:24,930 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000017 on node: host: 10.1.1.67:60564 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 16:08:24,930 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000025 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:24,930 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000025
2015-02-12 16:08:24,930 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000025 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 16:08:24,946 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0005_01_000020 is : 143
2015-02-12 16:08:24,954 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000020 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:08:24,954 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000020
2015-02-12 16:08:24,954 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000020
2015-02-12 16:08:24,955 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000020
2015-02-12 16:08:24,955 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000020
2015-02-12 16:08:24,955 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000020
2015-02-12 16:08:24,955 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000020 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:08:24,955 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000020 from application application_1423785972183_0005
2015-02-12 16:08:24,955 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:24,955 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:08:25,420 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000018 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:25,421 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000018 in state: COMPLETED event:FINISHED
2015-02-12 16:08:25,421 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000018
2015-02-12 16:08:25,421 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000018 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 16:08:25,421 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000018 on node: host: 10.1.1.67:60568 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 16:08:25,422 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000026 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:25,422 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000026
2015-02-12 16:08:25,422 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000026 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 16:08:25,452 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000019 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:25,452 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000019 in state: COMPLETED event:FINISHED
2015-02-12 16:08:25,453 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000019
2015-02-12 16:08:25,453 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000019 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 16:08:25,453 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000019 on node: host: 10.1.1.67:60556 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 16:08:25,454 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000027 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:25,454 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000027
2015-02-12 16:08:25,454 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000027 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 16:08:25,907 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000025 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:25,908 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000026 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:25,908 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000027 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:25,919 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:25,919 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:25,920 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:25,921 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000025 by user soberoi
2015-02-12 16:08:25,921 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000027 by user soberoi
2015-02-12 16:08:25,922 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000025
2015-02-12 16:08:25,922 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000025 to application application_1423785972183_0005
2015-02-12 16:08:25,922 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000026 by user soberoi
2015-02-12 16:08:25,922 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000025 transitioned from NEW to LOCALIZING
2015-02-12 16:08:25,922 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000027 to application application_1423785972183_0005
2015-02-12 16:08:25,922 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000026 to application application_1423785972183_0005
2015-02-12 16:08:25,923 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000027 transitioned from NEW to LOCALIZING
2015-02-12 16:08:25,923 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:08:25,923 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0005
2015-02-12 16:08:25,923 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:25,922 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000027
2015-02-12 16:08:25,923 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0005
2015-02-12 16:08:25,923 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000026 transitioned from NEW to LOCALIZING
2015-02-12 16:08:25,924 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:08:25,924 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0005
2015-02-12 16:08:25,924 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000027 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:25,922 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:08:25,925 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0005
2015-02-12 16:08:25,925 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:25,925 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0005
2015-02-12 16:08:25,922 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000026
2015-02-12 16:08:25,924 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:25,926 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0005
2015-02-12 16:08:25,926 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000025 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:25,926 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000026 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:25,937 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000025 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:25,937 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:25,937 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000020 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:25,938 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000020 in state: COMPLETED event:FINISHED
2015-02-12 16:08:25,938 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000020
2015-02-12 16:08:25,938 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000020 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 16:08:25,938 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000020 on node: host: 10.1.1.67:60564 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 16:08:25,938 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000028 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:25,938 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000028
2015-02-12 16:08:25,938 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000028 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 16:08:25,969 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000027 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:25,969 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:25,989 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000025 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:25,989 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:25,990 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000026 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:25,991 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:26,134 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000027/default_container_executor.sh]
2015-02-12 16:08:26,147 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000026/default_container_executor.sh]
2015-02-12 16:08:26,148 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000025/default_container_executor.sh]
2015-02-12 16:08:26,422 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000026 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:26,422 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:26,422 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000029 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:26,422 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000029
2015-02-12 16:08:26,422 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000029 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 16:08:26,453 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000027 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:26,453 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:26,453 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000030 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:26,453 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000030
2015-02-12 16:08:26,453 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000030 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 16:08:26,687 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30003 milliseconds
2015-02-12 16:08:26,688 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 16:08:26,852 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000031 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:26,852 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000031
2015-02-12 16:08:26,852 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000031 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 16:08:26,922 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000028 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:26,923 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000029 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:26,923 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000030 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:26,924 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000031 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:26,935 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:26,938 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0005_01_000017]
2015-02-12 16:08:26,938 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:26,938 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:26,939 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0005_01_000028 by user soberoi
2015-02-12 16:08:26,939 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000028
2015-02-12 16:08:26,939 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0005_01_000028 to application application_1423785972183_0005
2015-02-12 16:08:26,939 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000032 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:26,940 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000032
2015-02-12 16:08:26,940 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0005_01_000032 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 16:08:26,940 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000028 transitioned from NEW to LOCALIZING
2015-02-12 16:08:26,940 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0005
2015-02-12 16:08:26,940 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0005
2015-02-12 16:08:26,941 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:26,941 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0005
2015-02-12 16:08:26,941 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000028 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:26,997 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000028 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:26,997 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:27,152 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000028/default_container_executor.sh]
2015-02-12 16:08:27,424 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0005_01_000018]
2015-02-12 16:08:27,424 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:27,456 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0005_01_000019]
2015-02-12 16:08:27,456 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:27,933 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000029 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:08:27,933 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000029 in state: RELEASED event:RELEASED
2015-02-12 16:08:27,933 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000029
2015-02-12 16:08:27,933 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000029 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 16:08:27,933 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000029 on node: host: 10.1.1.67:60568 #containers=1 available=3072 used=1024 with event: RELEASED
2015-02-12 16:08:27,934 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000030 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:08:27,934 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000030 in state: RELEASED event:RELEASED
2015-02-12 16:08:27,934 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000030
2015-02-12 16:08:27,934 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000030 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 16:08:27,934 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000030 on node: host: 10.1.1.67:60556 #containers=2 available=1024 used=3072 with event: RELEASED
2015-02-12 16:08:27,934 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000031 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:08:27,934 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000031 in state: RELEASED event:RELEASED
2015-02-12 16:08:27,935 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000031
2015-02-12 16:08:27,935 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000031 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 16:08:27,935 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000031 on node: host: 10.1.1.67:60560 #containers=0 available=4096 used=0 with event: RELEASED
2015-02-12 16:08:27,935 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 16:08:27,935 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000032 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:27,944 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0005_01_000020]
2015-02-12 16:08:27,944 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000028 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:27,944 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:28,430 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0005_01_000029
2015-02-12 16:08:28,458 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0005_01_000030
2015-02-12 16:08:28,856 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0005_01_000031
2015-02-12 16:08:28,939 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000032 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:08:28,940 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000032 in state: RELEASED event:RELEASED
2015-02-12 16:08:28,940 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000032
2015-02-12 16:08:28,940 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000032 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 16:08:28,940 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000032 on node: host: 10.1.1.67:60564 #containers=3 available=1024 used=3072 with event: RELEASED
2015-02-12 16:08:28,950 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0005_01_000032
2015-02-12 16:08:33,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:33,116 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:33,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:33,312 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:08:33,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:08:33,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:08:33,830 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:33,832 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000025
2015-02-12 16:08:33,832 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000025
2015-02-12 16:08:33,832 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000025 transitioned from RUNNING to KILLING
2015-02-12 16:08:33,832 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000025
2015-02-12 16:08:33,843 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:33,844 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:33,846 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:33,847 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:33,854 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000026
2015-02-12 16:08:33,854 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000026
2015-02-12 16:08:33,854 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0005_01_000025 is : 143
2015-02-12 16:08:33,855 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000026 transitioned from RUNNING to KILLING
2015-02-12 16:08:33,855 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000026
2015-02-12 16:08:33,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:33,863 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000016
2015-02-12 16:08:33,863 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000016
2015-02-12 16:08:33,863 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000027
2015-02-12 16:08:33,864 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000027
2015-02-12 16:08:33,868 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000027 transitioned from RUNNING to KILLING
2015-02-12 16:08:33,868 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000027
2015-02-12 16:08:33,869 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000028
2015-02-12 16:08:33,869 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000028
2015-02-12 16:08:33,882 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0005_01_000026 is : 143
2015-02-12 16:08:33,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/3721187720_lower_A1877AA73DB348179CF770A6EF14E5AC/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 16:08:33,904 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0005_01_000027 is : 143
2015-02-12 16:08:33,918 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61046, dest: /127.0.0.1:60515, bytes: 74668, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1318689195_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741875_1051, duration: 34561437000
2015-02-12 16:08:33,918 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741875_1051, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:33,919 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]} size 15503
2015-02-12 16:08:33,920 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61045, dest: /127.0.0.1:60518, bytes: 74668, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1318689195_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741875_1051, duration: 34563248000
2015-02-12 16:08:33,920 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741875_1051, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:33,921 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000027 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:08:33,921 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000026 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:08:33,922 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000026
2015-02-12 16:08:33,922 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000026
2015-02-12 16:08:33,922 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61044, dest: /127.0.0.1:60521, bytes: 74668, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1318689195_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741875_1051, duration: 34565527000
2015-02-12 16:08:33,923 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741875_1051, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:33,924 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000026
2015-02-12 16:08:33,924 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000026 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:08:33,924 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000026 from application application_1423785972183_0005
2015-02-12 16:08:33,925 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:33,925 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:08:33,925 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000026
2015-02-12 16:08:33,924 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000026
2015-02-12 16:08:33,927 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]} size 15503
2015-02-12 16:08:33,928 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000027
2015-02-12 16:08:33,928 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000027 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:08:33,928 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000027 from application application_1423785972183_0005
2015-02-12 16:08:33,928 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:33,928 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:08:33,928 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job_1423785972183_0005_1.jhist is closed by DFSClient_NONMAPREDUCE_-1318689195_1
2015-02-12 16:08:33,929 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000027
2015-02-12 16:08:33,930 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000027
2015-02-12 16:08:33,930 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000027
2015-02-12 16:08:33,928 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741875_1051 size 74668
2015-02-12 16:08:33,932 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000027
2015-02-12 16:08:33,934 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:08:33,935 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000025 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:08:33,937 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005.summary_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]}
2015-02-12 16:08:33,938 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000016 transitioned from RUNNING to KILLING
2015-02-12 16:08:33,938 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000028 transitioned from RUNNING to KILLING
2015-02-12 16:08:33,940 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741880_1056 src: /127.0.0.1:61169 dest: /127.0.0.1:60515
2015-02-12 16:08:33,940 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000025
2015-02-12 16:08:33,942 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741880_1056 src: /127.0.0.1:61170 dest: /127.0.0.1:60521
2015-02-12 16:08:33,942 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000025
2015-02-12 16:08:33,943 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000025
2015-02-12 16:08:33,943 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741880_1056 src: /127.0.0.1:61171 dest: /127.0.0.1:60511
2015-02-12 16:08:33,946 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000025
2015-02-12 16:08:33,946 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000016
2015-02-12 16:08:33,947 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61171, dest: /127.0.0.1:60511, bytes: 425, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1318689195_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741880_1056, duration: 1377000
2015-02-12 16:08:33,948 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741880_1056, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:33,949 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]} size 0
2015-02-12 16:08:33,949 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61170, dest: /127.0.0.1:60521, bytes: 425, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1318689195_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741880_1056, duration: 2104000
2015-02-12 16:08:33,951 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741880_1056, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:33,951 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61169, dest: /127.0.0.1:60515, bytes: 425, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1318689195_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741880_1056, duration: 4792000
2015-02-12 16:08:33,952 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:33,952 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741880_1056, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:33,953 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:33,954 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1318689195_1
2015-02-12 16:08:33,959 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:08:33,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job_1423785972183_0005_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:08:33,969 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005-1423786047747-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F17E9DDA33D88476D-1423786113837-1-0-FAILED-root.soberoi-1423786054529.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:08:33,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job_1423785972183_0005_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:08:33,975 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0005_01_000016 is : 143
2015-02-12 16:08:33,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005-1423786047747-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F17E9DDA33D88476D-1423786113837-1-0-FAILED-root.soberoi-1423786054529.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:08:33,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job_1423785972183_0005_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:08:33,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005-1423786047747-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F17E9DDA33D88476D-1423786113837-1-0-FAILED-root.soberoi-1423786054529.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:08:33,987 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005-1423786047747-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F17E9DDA33D88476D-1423786113837-1-0-FAILED-root.soberoi-1423786054529.jhist_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:08:33,990 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741881_1057 src: /127.0.0.1:61173 dest: /127.0.0.1:60518
2015-02-12 16:08:33,991 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741881_1057 src: /127.0.0.1:61174 dest: /127.0.0.1:60515
2015-02-12 16:08:33,992 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741881_1057 src: /127.0.0.1:61175 dest: /127.0.0.1:60511
2015-02-12 16:08:33,993 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000028
2015-02-12 16:08:33,997 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61175, dest: /127.0.0.1:60511, bytes: 74668, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1318689195_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741881_1057, duration: 2536000
2015-02-12 16:08:33,997 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741881_1057, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:33,997 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 0
2015-02-12 16:08:33,997 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61174, dest: /127.0.0.1:60515, bytes: 74668, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1318689195_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741881_1057, duration: 2624000
2015-02-12 16:08:33,998 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741881_1057, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:33,998 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61173, dest: /127.0.0.1:60518, bytes: 74668, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1318689195_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741881_1057, duration: 3888000
2015-02-12 16:08:33,999 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741881_1057, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:33,998 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:33,999 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:34,003 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005-1423786047747-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F17E9DDA33D88476D-1423786113837-1-0-FAILED-root.soberoi-1423786054529.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1318689195_1
2015-02-12 16:08:34,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005-1423786047747-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F17E9DDA33D88476D-1423786113837-1-0-FAILED-root.soberoi-1423786054529.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:08:34,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job_1423785972183_0005_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:34,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:08:34,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job_1423785972183_0005_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:34,012 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:08:34,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005/job_1423785972183_0005_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:34,017 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:08:34,021 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0005_01_000028 is : 143
2015-02-12 16:08:34,028 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005_conf.xml_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]}
2015-02-12 16:08:34,032 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741882_1058 src: /127.0.0.1:61177 dest: /127.0.0.1:60518
2015-02-12 16:08:34,033 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741882_1058 src: /127.0.0.1:61178 dest: /127.0.0.1:60511
2015-02-12 16:08:34,035 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741882_1058 src: /127.0.0.1:61179 dest: /127.0.0.1:60515
2015-02-12 16:08:34,039 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61179, dest: /127.0.0.1:60515, bytes: 113699, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1318689195_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741882_1058, duration: 1879000
2015-02-12 16:08:34,040 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741882_1058, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:34,040 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:34,040 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61178, dest: /127.0.0.1:60511, bytes: 113699, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1318689195_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741882_1058, duration: 2717000
2015-02-12 16:08:34,041 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741882_1058, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:34,042 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:34,042 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61177, dest: /127.0.0.1:60518, bytes: 113699, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1318689195_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741882_1058, duration: 4004000
2015-02-12 16:08:34,042 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741882_1058, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:34,045 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:34,046 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1318689195_1
2015-02-12 16:08:34,048 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:08:34,054 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000025
2015-02-12 16:08:34,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:08:34,055 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000025 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:08:34,056 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000016 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:08:34,056 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000028 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:08:34,056 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000025 from application application_1423785972183_0005
2015-02-12 16:08:34,057 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:34,057 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:08:34,057 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000016
2015-02-12 16:08:34,058 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000016
2015-02-12 16:08:34,058 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000016
2015-02-12 16:08:34,058 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000016
2015-02-12 16:08:34,059 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000028
2015-02-12 16:08:34,060 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000028
2015-02-12 16:08:34,061 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000028
2015-02-12 16:08:34,061 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000028
2015-02-12 16:08:34,062 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000016
2015-02-12 16:08:34,063 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000016 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:08:34,064 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000028
2015-02-12 16:08:34,064 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000028 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:08:34,064 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000016 from application application_1423785972183_0005
2015-02-12 16:08:34,064 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:34,064 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:08:34,065 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000028 from application application_1423785972183_0005
2015-02-12 16:08:34,065 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:34,065 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:08:34,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:08:34,076 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005-1423786047747-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F17E9DDA33D88476D-1423786113837-1-0-FAILED-root.soberoi-1423786054529.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005-1423786047747-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F17E9DDA33D88476D-1423786113837-1-0-FAILED-root.soberoi-1423786054529.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:08:34,087 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423785972183_0005_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 16:08:34,088 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0005_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 16:08:34,088 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423785972183_0005 with final state: FINISHING
2015-02-12 16:08:34,089 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0005 State change from RUNNING to FINAL_SAVING
2015-02-12 16:08:34,089 INFO  recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423785972183_0005
2015-02-12 16:08:34,089 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0005_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 16:08:34,089 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0005 State change from FINAL_SAVING to FINISHING
2015-02-12 16:08:34,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:08:34,856 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000026 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:34,856 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000026 in state: COMPLETED event:FINISHED
2015-02-12 16:08:34,857 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000026
2015-02-12 16:08:34,857 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000026 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 16:08:34,857 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000026 on node: host: 10.1.1.67:60568 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 16:08:34,878 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000027 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:34,878 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000027 in state: COMPLETED event:FINISHED
2015-02-12 16:08:34,879 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000027
2015-02-12 16:08:34,879 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000027 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 16:08:34,879 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000027 on node: host: 10.1.1.67:60556 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 16:08:34,890 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000016 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:34,890 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000016 in state: COMPLETED event:FINISHED
2015-02-12 16:08:34,891 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000016
2015-02-12 16:08:34,891 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000016 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 16:08:34,891 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000016 on node: host: 10.1.1.67:60564 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 16:08:34,892 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000025 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:34,892 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000025 in state: COMPLETED event:FINISHED
2015-02-12 16:08:34,892 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000025
2015-02-12 16:08:34,892 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000025 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 16:08:34,893 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000025 on node: host: 10.1.1.67:60564 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 16:08:34,893 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000028 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:34,893 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000028 in state: COMPLETED event:FINISHED
2015-02-12 16:08:34,893 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000028
2015-02-12 16:08:34,893 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000028 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 16:08:34,893 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000028 on node: host: 10.1.1.67:60564 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 16:08:35,102 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423785972183_0005 unregistered successfully. 
2015-02-12 16:08:35,106 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741863_1039 127.0.0.1:60515 127.0.0.1:60518 127.0.0.1:60511 127.0.0.1:60521 
2015-02-12 16:08:35,106 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741865_1041 127.0.0.1:60515 127.0.0.1:60521 127.0.0.1:60518 127.0.0.1:60511 
2015-02-12 16:08:35,107 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741867_1043 127.0.0.1:60518 127.0.0.1:60511 127.0.0.1:60521 
2015-02-12 16:08:35,107 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741869_1045 127.0.0.1:60521 127.0.0.1:60515 127.0.0.1:60511 
2015-02-12 16:08:35,107 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741873_1049 127.0.0.1:60521 127.0.0.1:60518 127.0.0.1:60515 
2015-02-12 16:08:35,107 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741875_1051 127.0.0.1:60518 127.0.0.1:60515 127.0.0.1:60521 
2015-02-12 16:08:35,107 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741872_1048 127.0.0.1:60515 127.0.0.1:60521 127.0.0.1:60511 
2015-02-12 16:08:35,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0005	dst=null	perm=null	proto=rpc
2015-02-12 16:08:35,120 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] hadoop job job_1423785972183_0005 state at FAILED
2015-02-12 16:08:35,121 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] failure info: Task failed task_1423785972183_0005_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0

2015-02-12 16:08:35,144 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] task completion events identify failed tasks
2015-02-12 16:08:35,144 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] task completion events count: 10
2015-02-12 16:08:35,145 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] event = Task Id : attempt_1423785972183_0005_m_000001_0, Status : FAILED
2015-02-12 16:08:35,145 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] event = Task Id : attempt_1423785972183_0005_m_000003_0, Status : FAILED
2015-02-12 16:08:35,145 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] event = Task Id : attempt_1423785972183_0005_m_000000_0, Status : FAILED
2015-02-12 16:08:35,145 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] event = Task Id : attempt_1423785972183_0005_m_000002_0, Status : FAILED
2015-02-12 16:08:35,145 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] event = Task Id : attempt_1423785972183_0005_m_000004_0, Status : SUCCEEDED
2015-02-12 16:08:35,146 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] event = Task Id : attempt_1423785972183_0005_m_000000_1, Status : FAILED
2015-02-12 16:08:35,146 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] event = Task Id : attempt_1423785972183_0005_m_000001_1, Status : FAILED
2015-02-12 16:08:35,146 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] event = Task Id : attempt_1423785972183_0005_m_000003_1, Status : FAILED
2015-02-12 16:08:35,146 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] event = Task Id : attempt_1423785972183_0005_m_000002_1, Status : FAILED
2015-02-12 16:08:35,146 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] event = Task Id : attempt_1423785972183_0005_m_000000_2, Status : FAILED
2015-02-12 16:08:35,182 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] abandoning step: (3/3) ...latform/THROWABLE/stopped, predecessor failed: (2/3)
2015-02-12 16:08:35,182 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (3/3) ...latform/THROWABLE/stopped
2015-02-12 16:08:35,182 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] stopping all jobs
2015-02-12 16:08:35,183 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (3/3) ...latform/THROWABLE/stopped
2015-02-12 16:08:35,183 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (2/3)
2015-02-12 16:08:35,185 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (1/3)
2015-02-12 16:08:35,843 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60521 to delete [blk_1073741872_1048, blk_1073741873_1049, blk_1073741875_1051, blk_1073741863_1039, blk_1073741865_1041, blk_1073741867_1043, blk_1073741869_1045]
2015-02-12 16:08:35,844 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60518 to delete [blk_1073741873_1049, blk_1073741875_1051, blk_1073741863_1039, blk_1073741865_1041, blk_1073741867_1043]
2015-02-12 16:08:35,858 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:35,880 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:35,891 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:35,891 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:35,891 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:36,192 INFO  ipc.Client (Client.java:handleConnectionFailure(842)) - Retrying connect to server: 10.1.1.67/10.1.1.67:60942. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
2015-02-12 16:08:36,860 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:36,891 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:36,897 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:36,897 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:36,897 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:37,093 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741873 for deletion
2015-02-12 16:08:37,093 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741875 for deletion
2015-02-12 16:08:37,093 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741863 for deletion
2015-02-12 16:08:37,093 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741873
2015-02-12 16:08:37,094 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741865 for deletion
2015-02-12 16:08:37,094 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741863
2015-02-12 16:08:37,094 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741875
2015-02-12 16:08:37,094 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741867_1043 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741867 for deletion
2015-02-12 16:08:37,095 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741865
2015-02-12 16:08:37,095 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741867_1043 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741867
2015-02-12 16:08:37,200 INFO  ipc.Client (Client.java:handleConnectionFailure(842)) - Retrying connect to server: 10.1.1.67/10.1.1.67:60942. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
2015-02-12 16:08:37,400 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741872_1048 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741872 for deletion
2015-02-12 16:08:37,400 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741873 for deletion
2015-02-12 16:08:37,400 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741875 for deletion
2015-02-12 16:08:37,401 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741863 for deletion
2015-02-12 16:08:37,401 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741865 for deletion
2015-02-12 16:08:37,401 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741867_1043 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741867 for deletion
2015-02-12 16:08:37,401 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741872_1048 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741872
2015-02-12 16:08:37,401 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741869 for deletion
2015-02-12 16:08:37,401 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741863
2015-02-12 16:08:37,401 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741873
2015-02-12 16:08:37,402 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741875
2015-02-12 16:08:37,402 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741865
2015-02-12 16:08:37,402 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741867_1043 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741867
2015-02-12 16:08:37,403 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741869
2015-02-12 16:08:37,861 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:37,897 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:37,904 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:37,904 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:37,904 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:38,208 INFO  ipc.Client (Client.java:handleConnectionFailure(842)) - Retrying connect to server: 10.1.1.67/10.1.1.67:60942. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
2015-02-12 16:08:38,321 INFO  mapred.ClientServiceDelegate (ClientServiceDelegate.java:getProxy(273)) - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
2015-02-12 16:08:38,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005.summary	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004.summary	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,330 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423785972183_0004,submitTime=1423786047731,launchTime=1423786054072,firstMapTaskLaunchTime=1423786056315,firstReduceTaskLaunchTime=1423786081305,finishTime=1423786094701,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=112,reduceSlotSeconds=13,jobName=[2404B61D06B64A69A6AC8C117644964F/23BFE31346BC4224B862780BCCEF5943] lower*upper/(1/3)
2015-02-12 16:08:38,330 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004.summary]
2015-02-12 16:08:38,330 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423785972183_0005,submitTime=1423786047747,launchTime=1423786054529,firstMapTaskLaunchTime=1423786057270,firstReduceTaskLaunchTime=1423786082783,finishTime=1423786113837,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=FAILED,mapSlotSeconds=229,reduceSlotSeconds=31,jobName=[2404B61D06B64A69A6AC8C117644964F/17E9DDA33D88476DB83313E9E6C52062] lower*upper/(2/3)
2015-02-12 16:08:38,330 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005.summary]
2015-02-12 16:08:38,332 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741877_1053 127.0.0.1:60521 127.0.0.1:60511 127.0.0.1:60518 
2015-02-12 16:08:38,332 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741880_1056 127.0.0.1:60515 127.0.0.1:60521 127.0.0.1:60511 
2015-02-12 16:08:38,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004.summary	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005.summary	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,335 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004-1423786047731-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F23BFE31346BC4224-1423786094701-5-1-SUCCEEDED-root.soberoi-1423786054072.jhist to hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0004-1423786047731-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F23BFE31346BC4224-1423786094701-5-1-SUCCEEDED-root.soberoi-1423786054072.jhist
2015-02-12 16:08:38,335 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005-1423786047747-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F17E9DDA33D88476D-1423786113837-1-0-FAILED-root.soberoi-1423786054529.jhist to hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0005-1423786047747-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F17E9DDA33D88476D-1423786113837-1-0-FAILED-root.soberoi-1423786054529.jhist
2015-02-12 16:08:38,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004-1423786047731-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F23BFE31346BC4224-1423786094701-5-1-SUCCEEDED-root.soberoi-1423786054072.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0004-1423786047731-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F23BFE31346BC4224-1423786094701-5-1-SUCCEEDED-root.soberoi-1423786054072.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:08:38,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005-1423786047747-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F17E9DDA33D88476D-1423786113837-1-0-FAILED-root.soberoi-1423786054529.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0005-1423786047747-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F17E9DDA33D88476D-1423786113837-1-0-FAILED-root.soberoi-1423786054529.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:08:38,337 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004_conf.xml to hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0004_conf.xml
2015-02-12 16:08:38,337 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005_conf.xml to hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0005_conf.xml
2015-02-12 16:08:38,338 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0004_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0004_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:08:38,338 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0005_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0005_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:08:38,338 INFO  hs.CompletedJob (CompletedJob.java:<init>(95)) - Loading job: job_1423785972183_0004 from file: hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0004-1423786047731-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F23BFE31346BC4224-1423786094701-5-1-SUCCEEDED-root.soberoi-1423786054072.jhist
2015-02-12 16:08:38,339 INFO  hs.CompletedJob (CompletedJob.java:loadFullHistoryData(326)) - Loading history file: [hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0004-1423786047731-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F23BFE31346BC4224-1423786094701-5-1-SUCCEEDED-root.soberoi-1423786054072.jhist]
2015-02-12 16:08:38,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0004-1423786047731-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F23BFE31346BC4224-1423786094701-5-1-SUCCEEDED-root.soberoi-1423786054072.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0004-1423786047731-soberoi-%5B2404B61D06B64A69A6AC8C117644964F%2F23BFE31346BC4224-1423786094701-5-1-SUCCEEDED-root.soberoi-1423786054072.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,374 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] stopped all jobs
2015-02-12 16:08:38,374 WARN  flow.Flow (BaseFlow.java:logWarn(1388)) - [lower*upper] flow listener cascading.flow.FailingFlowListener@1800a5d5 threw throwable
java.lang.RuntimeException: intentionally failed on: THROWABLE
	at cascading.flow.FailingFlowListener.onThrowable(FailingFlowListener.java:69)
	at cascading.flow.BaseFlow$SafeFlowListener.onThrowable(BaseFlow.java:1568)
	at cascading.flow.BaseFlow.fireOnThrowable(BaseFlow.java:1331)
	at cascading.flow.BaseFlow.handleThrowableAndMarkFailed(BaseFlow.java:1235)
	at cascading.flow.BaseFlow.run(BaseFlow.java:1192)
	at cascading.flow.BaseFlow.access$100(BaseFlow.java:78)
	at cascading.flow.BaseFlow$1.run(BaseFlow.java:834)
	at java.lang.Thread.run(Thread.java:745)
2015-02-12 16:08:38,375 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] stopping all jobs
2015-02-12 16:08:38,375 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (3/3) ...latform/THROWABLE/stopped
2015-02-12 16:08:38,375 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (2/3)
2015-02-12 16:08:38,376 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (1/3)
2015-02-12 16:08:38,378 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] stopped all jobs
2015-02-12 16:08:38,379 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/flowplatform/THROWABLE/stopped
2015-02-12 16:08:38,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/THROWABLE/stopped	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,402 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 16:08:38,402 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 16:08:38,433 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(198)) - calling start
2015-02-12 16:08:38,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/stopped	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,435 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 16:08:38,435 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:38,436 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-02-12 16:08:38,436 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 16:08:38,436 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/stopped"]
2015-02-12 16:08:38,437 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  parallel execution is enabled: true
2015-02-12 16:08:38,437 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  starting jobs: 3
2015-02-12 16:08:38,437 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  allocating threads: 3
2015-02-12 16:08:38,440 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/3)
2015-02-12 16:08:38,441 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (2/3)
2015-02-12 16:08:38,453 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:60553
2015-02-12 16:08:38,482 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:60553
2015-02-12 16:08:38,494 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:60553
2015-02-12 16:08:38,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7482073258_lower_F9E2D12CA1944B3185799628339D0F4A	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,502 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 6
2015-02-12 16:08:38,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 16:08:38,506 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 16:08:38,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:08:38,513 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar. BP-2102022600-10.1.1.67-1423785955551 blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]}
2015-02-12 16:08:38,513 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:60553
2015-02-12 16:08:38,514 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741883_1059 src: /127.0.0.1:61194 dest: /127.0.0.1:60515
2015-02-12 16:08:38,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4259973568_upper_10F8FBFD2CC24F979486B9035D85B234	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,516 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,517 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741883_1059 src: /127.0.0.1:61195 dest: /127.0.0.1:60518
2015-02-12 16:08:38,520 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,520 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741883_1059 src: /127.0.0.1:61196 dest: /127.0.0.1:60521
2015-02-12 16:08:38,522 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 7
2015-02-12 16:08:38,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 16:08:38,536 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61196, dest: /127.0.0.1:60521, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741883_1059, duration: 13084000
2015-02-12 16:08:38,536 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741883_1059, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:38,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 16:08:38,537 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61195, dest: /127.0.0.1:60518, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741883_1059, duration: 9108000
2015-02-12 16:08:38,537 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741883_1059, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:38,537 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,539 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61194, dest: /127.0.0.1:60515, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741883_1059, duration: 15612000
2015-02-12 16:08:38,539 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,539 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741883_1059, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:38,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,541 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,542 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:08:38,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:08:38,543 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar
2015-02-12 16:08:38,544 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,546 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar. BP-2102022600-10.1.1.67-1423785955551 blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]}
2015-02-12 16:08:38,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:08:38,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,549 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741884_1060 src: /127.0.0.1:61197 dest: /127.0.0.1:60521
2015-02-12 16:08:38,549 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,550 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741884_1060 src: /127.0.0.1:61198 dest: /127.0.0.1:60515
2015-02-12 16:08:38,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,552 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741884_1060 src: /127.0.0.1:61199 dest: /127.0.0.1:60518
2015-02-12 16:08:38,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,563 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61199, dest: /127.0.0.1:60518, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741884_1060, duration: 7304000
2015-02-12 16:08:38,563 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741884_1060, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:38,565 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61198, dest: /127.0.0.1:60515, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741884_1060, duration: 6830000
2015-02-12 16:08:38,567 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61197, dest: /127.0.0.1:60521, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741884_1060, duration: 10596000
2015-02-12 16:08:38,567 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741884_1060, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:38,567 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741884_1060, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:38,568 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,570 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,570 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,571 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 16:08:38,571 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:08:38,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,572 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar
2015-02-12 16:08:38,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:08:38,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:08:38,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:08:38,577 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,577 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.split
2015-02-12 16:08:38,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,579 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.split. BP-2102022600-10.1.1.67-1423785955551 blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]}
2015-02-12 16:08:38,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,581 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741885_1061 src: /127.0.0.1:61200 dest: /127.0.0.1:60518
2015-02-12 16:08:38,581 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,583 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,583 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741885_1061 src: /127.0.0.1:61201 dest: /127.0.0.1:60515
2015-02-12 16:08:38,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,584 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741885_1061 src: /127.0.0.1:61202 dest: /127.0.0.1:60521
2015-02-12 16:08:38,587 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,587 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741885_1061 src: /127.0.0.1:61203 dest: /127.0.0.1:60511
2015-02-12 16:08:38,587 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 16:08:38,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,594 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:08:38,597 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:08:38,598 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.split
2015-02-12 16:08:38,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,600 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61203, dest: /127.0.0.1:60511, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741885_1061, duration: 10796000
2015-02-12 16:08:38,600 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741885_1061, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:38,601 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.split. BP-2102022600-10.1.1.67-1423785955551 blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:08:38,601 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61202, dest: /127.0.0.1:60521, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741885_1061, duration: 5026000
2015-02-12 16:08:38,601 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741885_1061, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:38,601 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,603 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61201, dest: /127.0.0.1:60515, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741885_1061, duration: 7558000
2015-02-12 16:08:38,603 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741885_1061, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:38,605 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,606 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61200, dest: /127.0.0.1:60518, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741885_1061, duration: 15252000
2015-02-12 16:08:38,606 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741885_1061, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:38,606 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,608 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741886_1062 src: /127.0.0.1:61204 dest: /127.0.0.1:60518
2015-02-12 16:08:38,610 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,611 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.split is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:08:38,611 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741886_1062 src: /127.0.0.1:61205 dest: /127.0.0.1:60521
2015-02-12 16:08:38,615 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741886_1062 src: /127.0.0.1:61206 dest: /127.0.0.1:60515
2015-02-12 16:08:38,616 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:08:38,620 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741886_1062 src: /127.0.0.1:61207 dest: /127.0.0.1:60511
2015-02-12 16:08:38,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:08:38,625 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.splitmetainfo. BP-2102022600-10.1.1.67-1423785955551 blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]}
2015-02-12 16:08:38,629 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741887_1063 src: /127.0.0.1:61208 dest: /127.0.0.1:60521
2015-02-12 16:08:38,630 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61207, dest: /127.0.0.1:60511, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741886_1062, duration: 5371000
2015-02-12 16:08:38,630 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741886_1062, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:38,632 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61206, dest: /127.0.0.1:60515, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741886_1062, duration: 5824000
2015-02-12 16:08:38,632 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741886_1062, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:38,634 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61205, dest: /127.0.0.1:60521, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741886_1062, duration: 9105000
2015-02-12 16:08:38,634 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741886_1062, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:38,642 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,645 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741887_1063 src: /127.0.0.1:61209 dest: /127.0.0.1:60511
2015-02-12 16:08:38,647 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61204, dest: /127.0.0.1:60518, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741886_1062, duration: 19412000
2015-02-12 16:08:38,648 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741886_1062, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:38,649 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,651 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,654 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741887_1063 src: /127.0.0.1:61210 dest: /127.0.0.1:60515
2015-02-12 16:08:38,655 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.split is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:08:38,657 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741886_1062 size 1787
2015-02-12 16:08:38,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:08:38,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:08:38,665 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61210, dest: /127.0.0.1:60515, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741887_1063, duration: 7491000
2015-02-12 16:08:38,665 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741887_1063, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:38,667 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61209, dest: /127.0.0.1:60511, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741887_1063, duration: 7621000
2015-02-12 16:08:38,667 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741887_1063, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:38,668 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,669 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61208, dest: /127.0.0.1:60521, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741887_1063, duration: 10164000
2015-02-12 16:08:38,669 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.splitmetainfo. BP-2102022600-10.1.1.67-1423785955551 blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]}
2015-02-12 16:08:38,669 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741887_1063, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:38,673 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,678 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,678 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741888_1064 src: /127.0.0.1:61211 dest: /127.0.0.1:60515
2015-02-12 16:08:38,679 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:08:38,681 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 16:08:38,681 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741888_1064 src: /127.0.0.1:61212 dest: /127.0.0.1:60511
2015-02-12 16:08:38,682 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:08:38,685 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741888_1064 src: /127.0.0.1:61213 dest: /127.0.0.1:60521
2015-02-12 16:08:38,686 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:08:38,696 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61213, dest: /127.0.0.1:60521, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741888_1064, duration: 9303000
2015-02-12 16:08:38,697 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741888_1064, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:38,697 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,697 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61212, dest: /127.0.0.1:60511, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741888_1064, duration: 8365000
2015-02-12 16:08:38,697 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741888_1064, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:38,698 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,698 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61211, dest: /127.0.0.1:60515, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741888_1064, duration: 9578000
2015-02-12 16:08:38,698 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741888_1064, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:38,699 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,700 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:08:38,701 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 16:08:38,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:08:38,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:08:38,732 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml. BP-2102022600-10.1.1.67-1423785955551 blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]}
2015-02-12 16:08:38,736 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741889_1065 src: /127.0.0.1:61214 dest: /127.0.0.1:60521
2015-02-12 16:08:38,738 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741889_1065 src: /127.0.0.1:61215 dest: /127.0.0.1:60515
2015-02-12 16:08:38,740 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741889_1065 src: /127.0.0.1:61216 dest: /127.0.0.1:60518
2015-02-12 16:08:38,743 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml. BP-2102022600-10.1.1.67-1423785955551 blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]}
2015-02-12 16:08:38,747 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741890_1066 src: /127.0.0.1:61217 dest: /127.0.0.1:60511
2015-02-12 16:08:38,748 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741890_1066 src: /127.0.0.1:61218 dest: /127.0.0.1:60518
2015-02-12 16:08:38,750 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741890_1066 src: /127.0.0.1:61219 dest: /127.0.0.1:60515
2015-02-12 16:08:38,752 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61216, dest: /127.0.0.1:60518, bytes: 96394, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741889_1065, duration: 10781000
2015-02-12 16:08:38,753 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741889_1065, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:38,754 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61215, dest: /127.0.0.1:60515, bytes: 96394, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741889_1065, duration: 11878000
2015-02-12 16:08:38,754 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741889_1065, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:38,754 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,755 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61214, dest: /127.0.0.1:60521, bytes: 96394, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741889_1065, duration: 13435000
2015-02-12 16:08:38,756 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741889_1065, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:38,756 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,765 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,766 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61219, dest: /127.0.0.1:60515, bytes: 96390, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741890_1066, duration: 13583000
2015-02-12 16:08:38,767 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741890_1066, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:38,768 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61218, dest: /127.0.0.1:60518, bytes: 96390, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741890_1066, duration: 11917000
2015-02-12 16:08:38,769 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741890_1066, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:38,770 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]} size 0
2015-02-12 16:08:38,770 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61217, dest: /127.0.0.1:60511, bytes: 96390, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741890_1066, duration: 15096000
2015-02-12 16:08:38,770 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]} size 0
2015-02-12 16:08:38,770 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741890_1066, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:38,771 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:38,774 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:08:38,775 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423785972183_0007
2015-02-12 16:08:38,776 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:08:38,777 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,777 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423785972183_0006
2015-02-12 16:08:38,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,782 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,782 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,784 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,790 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,798 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,798 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,799 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,799 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,801 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 7 submitted by user soberoi
2015-02-12 16:08:38,801 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi	IP=10.1.1.67	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423785972183_0007
2015-02-12 16:08:38,802 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423785972183_0007
2015-02-12 16:08:38,802 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0007 State change from NEW to NEW_SAVING
2015-02-12 16:08:38,802 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423785972183_0007
2015-02-12 16:08:38,801 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:38,802 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0007 State change from NEW_SAVING to SUBMITTED
2015-02-12 16:08:38,803 INFO  fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423785972183_0007 from user: soberoi, in queue: default, currently num of applications: 2
2015-02-12 16:08:38,804 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0007 State change from SUBMITTED to ACCEPTED
2015-02-12 16:08:38,804 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423785972183_0007
2015-02-12 16:08:38,804 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423785972183_0007_000001
2015-02-12 16:08:38,804 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0007_000001 State change from NEW to SUBMITTED
2015-02-12 16:08:38,804 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 6 submitted by user soberoi
2015-02-12 16:08:38,805 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi	IP=10.1.1.67	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423785972183_0006
2015-02-12 16:08:38,805 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423785972183_0006
2015-02-12 16:08:38,805 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0006 State change from NEW to NEW_SAVING
2015-02-12 16:08:38,805 INFO  fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423785972183_0007_000001 to scheduler from user: soberoi
2015-02-12 16:08:38,805 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423785972183_0006
2015-02-12 16:08:38,806 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0007_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 16:08:38,806 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0006 State change from NEW_SAVING to SUBMITTED
2015-02-12 16:08:38,806 INFO  fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423785972183_0006 from user: soberoi, in queue: default, currently num of applications: 3
2015-02-12 16:08:38,807 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423785972183_0006
2015-02-12 16:08:38,807 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0006 State change from SUBMITTED to ACCEPTED
2015-02-12 16:08:38,807 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423785972183_0006_000001
2015-02-12 16:08:38,808 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0006_000001 State change from NEW to SUBMITTED
2015-02-12 16:08:38,807 INFO  mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:60554/proxy/application_1423785972183_0007/
2015-02-12 16:08:38,808 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423785972183_0007
2015-02-12 16:08:38,808 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60554/proxy/application_1423785972183_0007/
2015-02-12 16:08:38,808 INFO  fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423785972183_0006_000001 to scheduler from user: soberoi
2015-02-12 16:08:38,809 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0006_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 16:08:38,811 INFO  mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:60554/proxy/application_1423785972183_0006/
2015-02-12 16:08:38,811 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423785972183_0006
2015-02-12 16:08:38,811 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60554/proxy/application_1423785972183_0006/
2015-02-12 16:08:38,847 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:60515 to replicate blk_1073741883_1059 to datanode(s) 127.0.0.1:60511
2015-02-12 16:08:38,847 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:60518 to replicate blk_1073741884_1060 to datanode(s) 127.0.0.1:60511
2015-02-12 16:08:38,848 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60518 to delete [blk_1073741877_1053]
2015-02-12 16:08:38,848 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60511 to delete [blk_1073741872_1048, blk_1073741877_1053, blk_1073741863_1039, blk_1073741880_1056, blk_1073741865_1041, blk_1073741867_1043, blk_1073741869_1045]
2015-02-12 16:08:38,869 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:38,871 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:38,871 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000001
2015-02-12 16:08:38,871 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0007_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:60568, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 16:08:38,871 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60568 for container : container_1423785972183_0007_01_000001
2015-02-12 16:08:38,872 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:38,872 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423785972183_0007_000001
2015-02-12 16:08:38,872 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423785972183_0007 AttemptId: appattempt_1423785972183_0007_000001 MasterContainer: Container: [ContainerId: container_1423785972183_0007_01_000001, NodeId: 10.1.1.67:60568, NodeHttpAddress: 10.1.1.67:60571, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60568 }, ]
2015-02-12 16:08:38,872 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0007_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 16:08:38,872 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0007_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 16:08:38,873 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423785972183_0007_000001
2015-02-12 16:08:38,874 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423785972183_0007_01_000001, NodeId: 10.1.1.67:60568, NodeHttpAddress: 10.1.1.67:60571, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60568 }, ] for AM appattempt_1423785972183_0007_000001
2015-02-12 16:08:38,874 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423785972183_0007_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 16:08:38,874 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423785972183_0007_000001
2015-02-12 16:08:38,875 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423785972183_0007_000001
2015-02-12 16:08:38,877 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0007_000001 (auth:SIMPLE)
2015-02-12 16:08:38,879 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0007_01_000001 by user soberoi
2015-02-12 16:08:38,879 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0007
2015-02-12 16:08:38,880 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000001
2015-02-12 16:08:38,880 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0007 transitioned from NEW to INITING
2015-02-12 16:08:38,880 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0007_01_000001 to application application_1423785972183_0007
2015-02-12 16:08:38,880 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0007 transitioned from INITING to RUNNING
2015-02-12 16:08:38,880 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423785972183_0007_01_000001, NodeId: 10.1.1.67:60568, NodeHttpAddress: 10.1.1.67:60571, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60568 }, ] for AM appattempt_1423785972183_0007_000001
2015-02-12 16:08:38,880 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0007_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 16:08:38,880 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 16:08:38,881 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0007
2015-02-12 16:08:38,881 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:08:38,881 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 16:08:38,881 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.split transitioned from INIT to DOWNLOADING
2015-02-12 16:08:38,881 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:08:38,881 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0007_01_000001
2015-02-12 16:08:38,896 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423785972183_0007_01_000001.tokens. Credentials list: 
2015-02-12 16:08:38,902 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:38,904 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:38,905 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000001
2015-02-12 16:08:38,905 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0006_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:60556, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 16:08:38,905 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60556 for container : container_1423785972183_0006_01_000001
2015-02-12 16:08:38,905 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:38,906 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423785972183_0006_000001
2015-02-12 16:08:38,906 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423785972183_0006 AttemptId: appattempt_1423785972183_0006_000001 MasterContainer: Container: [ContainerId: container_1423785972183_0006_01_000001, NodeId: 10.1.1.67:60556, NodeHttpAddress: 10.1.1.67:60559, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60556 }, ]
2015-02-12 16:08:38,906 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0006_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 16:08:38,906 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0006_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 16:08:38,906 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423785972183_0006_000001
2015-02-12 16:08:38,908 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423785972183_0006_01_000001, NodeId: 10.1.1.67:60556, NodeHttpAddress: 10.1.1.67:60559, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60556 }, ] for AM appattempt_1423785972183_0006_000001
2015-02-12 16:08:38,908 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423785972183_0006_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 16:08:38,909 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423785972183_0006_000001
2015-02-12 16:08:38,909 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423785972183_0006_000001
2015-02-12 16:08:38,910 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:38,911 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:38,911 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:38,912 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0006_000001 (auth:SIMPLE)
2015-02-12 16:08:38,914 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0006_01_000001 by user soberoi
2015-02-12 16:08:38,915 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0006
2015-02-12 16:08:38,915 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000001
2015-02-12 16:08:38,915 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0006 transitioned from NEW to INITING
2015-02-12 16:08:38,915 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0006_01_000001 to application application_1423785972183_0006
2015-02-12 16:08:38,915 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0006 transitioned from INITING to RUNNING
2015-02-12 16:08:38,915 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423785972183_0006_01_000001, NodeId: 10.1.1.67:60556, NodeHttpAddress: 10.1.1.67:60559, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60556 }, ] for AM appattempt_1423785972183_0006_000001
2015-02-12 16:08:38,916 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0006_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 16:08:38,916 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 16:08:38,916 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0006
2015-02-12 16:08:38,916 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:08:38,916 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 16:08:38,916 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.split transitioned from INIT to DOWNLOADING
2015-02-12 16:08:38,916 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:08:38,917 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0006_01_000001
2015-02-12 16:08:38,931 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423785972183_0006_01_000001.tokens. Credentials list: 
2015-02-12 16:08:39,050 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:08:39,083 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:08:39,163 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741880_1056
2015-02-12 16:08:39,169 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1423785972183_0007_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000001.tokens
2015-02-12 16:08:39,170 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0007
2015-02-12 16:08:39,207 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423785972183_0006_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000001.tokens
2015-02-12 16:08:39,207 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0006
2015-02-12 16:08:39,306 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:39,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:39,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:39,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:39,374 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0007/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:08:39,390 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0006/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:08:39,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:08:39,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:08:39,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:08:39,425 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:08:39,439 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:39,454 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0007/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:08:39,471 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0006/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:08:39,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:39,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:39,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:39,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:08:39,540 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0007/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:08:39,552 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0006/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:08:39,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:39,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:39,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:39,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:39,620 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0007/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:08:39,620 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:39,632 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0006/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:08:39,632 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:39,671 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:39,672 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:39,687 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:39,687 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:39,721 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741872_1048 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741872 for deletion
2015-02-12 16:08:39,722 INFO  datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=3ba35078-bb62-4777-80dc-a38267fd3486, infoPort=60516, ipcPort=60517, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0) Starting thread to transfer BP-2102022600-10.1.1.67-1423785955551:blk_1073741883_1059 to 127.0.0.1:60511 
2015-02-12 16:08:39,725 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741877 for deletion
2015-02-12 16:08:39,725 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741863 for deletion
2015-02-12 16:08:39,726 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741880 for deletion
2015-02-12 16:08:39,726 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741865 for deletion
2015-02-12 16:08:39,726 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741867_1043 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741867 for deletion
2015-02-12 16:08:39,726 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741869 for deletion
2015-02-12 16:08:39,728 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741872_1048 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741872
2015-02-12 16:08:39,728 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741877
2015-02-12 16:08:39,729 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741863
2015-02-12 16:08:39,730 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741880
2015-02-12 16:08:39,730 INFO  datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-2102022600-10.1.1.67-1423785955551:blk_1073741883_1059 (numBytes=254067) to /127.0.0.1:60511
2015-02-12 16:08:39,731 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741865
2015-02-12 16:08:39,731 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741867_1043 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741867
2015-02-12 16:08:39,732 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741869
2015-02-12 16:08:39,733 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741883_1059 src: /127.0.0.1:61228 dest: /127.0.0.1:60511
2015-02-12 16:08:39,735 INFO  datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-2102022600-10.1.1.67-1423785955551:blk_1073741883_1059 src: /127.0.0.1:61228 dest: /127.0.0.1:60511 of size 254067
2015-02-12 16:08:39,736 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741883_1059 size 254067
2015-02-12 16:08:39,804 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000001/default_container_executor.sh]
2015-02-12 16:08:39,823 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000001/default_container_executor.sh]
2015-02-12 16:08:39,875 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:39,875 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:39,906 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:39,906 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:39,919 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:39,919 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:39,919 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:40,099 INFO  datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=1309dd03-96de-4536-9ff7-96af7fbd7a36, infoPort=60519, ipcPort=60520, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0) Starting thread to transfer BP-2102022600-10.1.1.67-1423785955551:blk_1073741884_1060 to 127.0.0.1:60511 
2015-02-12 16:08:40,099 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741877 for deletion
2015-02-12 16:08:40,100 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741877
2015-02-12 16:08:40,100 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741884_1060 src: /127.0.0.1:61230 dest: /127.0.0.1:60511
2015-02-12 16:08:40,101 INFO  datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-2102022600-10.1.1.67-1423785955551:blk_1073741884_1060 (numBytes=254067) to /127.0.0.1:60511
2015-02-12 16:08:40,102 INFO  datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-2102022600-10.1.1.67-1423785955551:blk_1073741884_1060 src: /127.0.0.1:61230 dest: /127.0.0.1:60511 of size 254067
2015-02-12 16:08:40,103 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741884_1060 size 254067
2015-02-12 16:08:40,174 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423785972183_0005_01_000001 succeeded 
2015-02-12 16:08:40,175 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 16:08:40,175 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0005_01_000001
2015-02-12 16:08:40,198 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000001
2015-02-12 16:08:40,198 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000001
2015-02-12 16:08:40,199 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000001
2015-02-12 16:08:40,199 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0005_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 16:08:40,199 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0005_01_000001 from application application_1423785972183_0005
2015-02-12 16:08:40,199 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000001
2015-02-12 16:08:40,199 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0005/container_1423785972183_0005_01_000001
2015-02-12 16:08:40,199 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:40,200 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0005
2015-02-12 16:08:40,441 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:40,883 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:40,910 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0005_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:08:40,910 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423785972183_0005_000001
2015-02-12 16:08:40,910 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423785972183_0005_000001
2015-02-12 16:08:40,910 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0005_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 16:08:40,911 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000001
2015-02-12 16:08:40,911 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0005_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:60556, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 16:08:40,911 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0005_000001 released container container_1423785972183_0005_01_000001 on node: host: 10.1.1.67:60556 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 16:08:40,911 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:40,910 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0005_000001 State change from FINISHING to FINISHED
2015-02-12 16:08:40,911 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0005 State change from FINISHING to FINISHED
2015-02-12 16:08:40,912 INFO  fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423785972183_0005_000001 is done. finalState=FINISHED
2015-02-12 16:08:40,912 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1423785972183_0005
2015-02-12 16:08:40,912 INFO  amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423785972183_0005_000001
2015-02-12 16:08:40,912 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423785972183_0005,name=[2404B61D06B64A69A6AC8C117644964F/17E9DDA33D88476DB83313E9E6C52062] lower*upper/(2/3),user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:60554/proxy/application_1423785972183_0005/jobhistory/job/job_1423785972183_0005,appMasterHost=10.1.1.67,startTime=1423786047747,finishTime=1423786114088,finalStatus=FAILED
2015-02-12 16:08:40,912 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423785972183_0005 requests cleared
2015-02-12 16:08:40,915 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0005_000001 (auth:SIMPLE)
2015-02-12 16:08:40,916 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0005_01_000001
2015-02-12 16:08:40,916 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0005	CONTAINERID=container_1423785972183_0005_01_000001
2015-02-12 16:08:40,917 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0005_01_000001]
2015-02-12 16:08:40,917 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:40,917 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:40,917 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:08:40,918 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:08:40,918 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0005
2015-02-12 16:08:40,918 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:08:40,919 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0005, with delay of 10800 seconds
2015-02-12 16:08:40,919 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:08:40,920 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:08:40,922 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:08:40,929 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:40,929 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:40,929 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:40,929 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:08:40,930 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0005
2015-02-12 16:08:40,930 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:08:40,931 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0005, with delay of 10800 seconds
2015-02-12 16:08:40,931 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:08:40,932 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0005
2015-02-12 16:08:40,932 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:08:40,932 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0005, with delay of 10800 seconds
2015-02-12 16:08:40,932 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:08:40,933 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:08:40,934 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:08:40,936 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:08:40,936 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:08:40,938 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:08:40,938 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:08:40,939 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:08:41,450 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:41,854 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60515 to delete [blk_1073741872_1048, blk_1073741873_1049, blk_1073741875_1051, blk_1073741863_1039, blk_1073741880_1056, blk_1073741865_1041, blk_1073741869_1045]
2015-02-12 16:08:41,854 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60521 to delete [blk_1073741877_1053, blk_1073741880_1056]
2015-02-12 16:08:41,893 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:41,894 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:08:41,894 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:08:41,895 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:08:41,895 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0005
2015-02-12 16:08:41,895 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:08:41,895 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:08:41,895 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0005, with delay of 10800 seconds
2015-02-12 16:08:41,896 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0005
2015-02-12 16:08:41,918 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:41,930 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:41,930 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:41,930 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:42,452 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:42,724 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741872_1048 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741872 for deletion
2015-02-12 16:08:42,724 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741873 for deletion
2015-02-12 16:08:42,725 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741875 for deletion
2015-02-12 16:08:42,725 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741863 for deletion
2015-02-12 16:08:42,725 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741880 for deletion
2015-02-12 16:08:42,725 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741865 for deletion
2015-02-12 16:08:42,725 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741869 for deletion
2015-02-12 16:08:42,725 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741872_1048 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741872
2015-02-12 16:08:42,726 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741863
2015-02-12 16:08:42,725 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741873
2015-02-12 16:08:42,726 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741865
2015-02-12 16:08:42,726 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741875
2015-02-12 16:08:42,726 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741880
2015-02-12 16:08:42,727 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741869
2015-02-12 16:08:42,850 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:08:42,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:08:42,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 16:08:42,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 16:08:42,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 16:08:42,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 16:08:42,895 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:08:42,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 16:08:42,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 16:08:43,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007	dst=null	perm=null	proto=rpc
2015-02-12 16:08:43,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006	dst=null	perm=null	proto=rpc
2015-02-12 16:08:43,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 16:08:43,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 16:08:43,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:08:43,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:08:43,069 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741881_1057
2015-02-12 16:08:43,070 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741882_1058
2015-02-12 16:08:43,415 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741877 for deletion
2015-02-12 16:08:43,416 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741880 for deletion
2015-02-12 16:08:43,416 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741877
2015-02-12 16:08:43,416 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741880
2015-02-12 16:08:43,421 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:08:43,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:08:43,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:08:43,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:08:43,457 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:43,459 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741881_1057
2015-02-12 16:08:43,460 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741882_1058
2015-02-12 16:08:43,679 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741883_1059
2015-02-12 16:08:43,680 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741885_1061
2015-02-12 16:08:43,889 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741884_1060
2015-02-12 16:08:44,082 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741881_1057
2015-02-12 16:08:44,083 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741886_1062
2015-02-12 16:08:44,084 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741882_1058
2015-02-12 16:08:44,175 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741884_1060
2015-02-12 16:08:44,175 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741885_1061
2015-02-12 16:08:44,383 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741883_1059
2015-02-12 16:08:44,383 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741886_1062
2015-02-12 16:08:44,384 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741887_1063
2015-02-12 16:08:44,463 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:44,580 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741889_1065
2015-02-12 16:08:44,580 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741888_1064
2015-02-12 16:08:45,141 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0006_000001 (auth:SIMPLE)
2015-02-12 16:08:45,143 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423785972183_0006_000001
2015-02-12 16:08:45,143 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi	IP=10.1.1.67	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423785972183_0006	APPATTEMPTID=appattempt_1423785972183_0006_000001
2015-02-12 16:08:45,144 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0006_000001 State change from LAUNCHED to RUNNING
2015-02-12 16:08:45,144 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0006 State change from ACCEPTED to RUNNING
2015-02-12 16:08:45,200 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0007_000001 (auth:SIMPLE)
2015-02-12 16:08:45,204 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423785972183_0007_000001
2015-02-12 16:08:45,204 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi	IP=10.1.1.67	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423785972183_0007	APPATTEMPTID=appattempt_1423785972183_0007_000001
2015-02-12 16:08:45,204 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0007_000001 State change from LAUNCHED to RUNNING
2015-02-12 16:08:45,205 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0007 State change from ACCEPTED to RUNNING
2015-02-12 16:08:45,234 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job_1423785972183_0006_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:08:45,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/7482073258_lower_F9E2D12CA1944B3185799628339D0F4A/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 16:08:45,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job_1423785972183_0007_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:08:45,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/4259973568_upper_10F8FBFD2CC24F979486B9035D85B234/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 16:08:45,406 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job_1423785972183_0006_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:08:45,506 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job_1423785972183_0007_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:08:45,507 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:45,848 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job_1423785972183_0006_1_conf.xml. BP-2102022600-10.1.1.67-1423785955551 blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]}
2015-02-12 16:08:45,908 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741891_1067 src: /127.0.0.1:61251 dest: /127.0.0.1:60515
2015-02-12 16:08:45,910 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741891_1067 src: /127.0.0.1:61252 dest: /127.0.0.1:60511
2015-02-12 16:08:45,912 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741891_1067 src: /127.0.0.1:61253 dest: /127.0.0.1:60518
2015-02-12 16:08:46,001 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61253, dest: /127.0.0.1:60518, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1681212327_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741891_1067, duration: 87441000
2015-02-12 16:08:46,001 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741891_1067, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:46,001 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:46,002 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61252, dest: /127.0.0.1:60511, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1681212327_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741891_1067, duration: 88081000
2015-02-12 16:08:46,002 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741891_1067, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:46,003 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:46,003 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61251, dest: /127.0.0.1:60515, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1681212327_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741891_1067, duration: 89457000
2015-02-12 16:08:46,003 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741891_1067, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:46,004 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:46,012 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job_1423785972183_0007_1_conf.xml. BP-2102022600-10.1.1.67-1423785955551 blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]}
2015-02-12 16:08:46,015 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job_1423785972183_0006_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1681212327_1
2015-02-12 16:08:46,066 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741892_1068 src: /127.0.0.1:61256 dest: /127.0.0.1:60511
2015-02-12 16:08:46,068 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741892_1068 src: /127.0.0.1:61257 dest: /127.0.0.1:60518
2015-02-12 16:08:46,071 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741892_1068 src: /127.0.0.1:61258 dest: /127.0.0.1:60521
2015-02-12 16:08:46,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job_1423785972183_0006.summary	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:08:46,128 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job_1423785972183_0006.summary. BP-2102022600-10.1.1.67-1423785955551 blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]}
2015-02-12 16:08:46,130 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741893_1069 src: /127.0.0.1:61259 dest: /127.0.0.1:60518
2015-02-12 16:08:46,132 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741893_1069 src: /127.0.0.1:61260 dest: /127.0.0.1:60521
2015-02-12 16:08:46,135 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741893_1069 src: /127.0.0.1:61261 dest: /127.0.0.1:60515
2015-02-12 16:08:46,139 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61261, dest: /127.0.0.1:60515, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1681212327_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741893_1069, duration: 2073000
2015-02-12 16:08:46,140 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741893_1069, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:46,140 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]} size 0
2015-02-12 16:08:46,141 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61260, dest: /127.0.0.1:60521, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1681212327_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741893_1069, duration: 3074000
2015-02-12 16:08:46,143 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741893_1069, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:46,145 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61259, dest: /127.0.0.1:60518, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1681212327_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741893_1069, duration: 7219000
2015-02-12 16:08:46,145 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:46,145 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741893_1069, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:46,146 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|FINALIZED]]} size 0
2015-02-12 16:08:46,150 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job_1423785972183_0006.summary is closed by DFSClient_NONMAPREDUCE_-1681212327_1
2015-02-12 16:08:46,160 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61258, dest: /127.0.0.1:60521, bytes: 113219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1007363385_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741892_1068, duration: 86007000
2015-02-12 16:08:46,160 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741892_1068, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:46,161 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]} size 0
2015-02-12 16:08:46,161 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61257, dest: /127.0.0.1:60518, bytes: 113219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1007363385_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741892_1068, duration: 86751000
2015-02-12 16:08:46,162 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741892_1068, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:46,162 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]} size 0
2015-02-12 16:08:46,163 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61256, dest: /127.0.0.1:60511, bytes: 113219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1007363385_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741892_1068, duration: 88849000
2015-02-12 16:08:46,163 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741892_1068, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:46,165 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]} size 0
2015-02-12 16:08:46,198 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job_1423785972183_0007_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1007363385_1
2015-02-12 16:08:46,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job_1423785972183_0007.summary	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:08:46,256 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job_1423785972183_0007.summary. BP-2102022600-10.1.1.67-1423785955551 blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]}
2015-02-12 16:08:46,259 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741894_1070 src: /127.0.0.1:61262 dest: /127.0.0.1:60521
2015-02-12 16:08:46,261 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741894_1070 src: /127.0.0.1:61263 dest: /127.0.0.1:60518
2015-02-12 16:08:46,263 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741894_1070 src: /127.0.0.1:61264 dest: /127.0.0.1:60511
2015-02-12 16:08:46,268 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61264, dest: /127.0.0.1:60511, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1007363385_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741894_1070, duration: 2084000
2015-02-12 16:08:46,268 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741894_1070, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:08:46,268 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]} size 0
2015-02-12 16:08:46,268 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61263, dest: /127.0.0.1:60518, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1007363385_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741894_1070, duration: 2402000
2015-02-12 16:08:46,269 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741894_1070, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:46,269 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]} size 0
2015-02-12 16:08:46,269 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61262, dest: /127.0.0.1:60521, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1007363385_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741894_1070, duration: 3573000
2015-02-12 16:08:46,270 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741894_1070, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:08:46,270 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]} size 0
2015-02-12 16:08:46,275 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job_1423785972183_0007.summary is closed by DFSClient_NONMAPREDUCE_-1007363385_1
2015-02-12 16:08:46,517 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:46,905 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:46,905 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000002
2015-02-12 16:08:46,905 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0007_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 16:08:46,943 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:46,943 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000002
2015-02-12 16:08:46,943 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0006_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 16:08:46,959 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:46,960 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000003
2015-02-12 16:08:46,960 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0007_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 16:08:46,960 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:46,960 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000003
2015-02-12 16:08:46,960 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0006_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 16:08:47,213 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60556 for container : container_1423785972183_0006_01_000002
2015-02-12 16:08:47,213 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:47,214 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60560 for container : container_1423785972183_0006_01_000003
2015-02-12 16:08:47,215 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:47,273 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,294 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,319 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,321 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,396 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0006_000001 (auth:SIMPLE)
2015-02-12 16:08:47,396 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0006_000001 (auth:SIMPLE)
2015-02-12 16:08:47,400 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0006_01_000002 by user soberoi
2015-02-12 16:08:47,401 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000002
2015-02-12 16:08:47,401 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0006_01_000002 to application application_1423785972183_0006
2015-02-12 16:08:47,401 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0006_01_000003 by user soberoi
2015-02-12 16:08:47,401 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 16:08:47,401 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0006
2015-02-12 16:08:47,401 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0006
2015-02-12 16:08:47,401 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0006
2015-02-12 16:08:47,402 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:47,402 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000003
2015-02-12 16:08:47,402 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0006
2015-02-12 16:08:47,402 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0006 transitioned from NEW to INITING
2015-02-12 16:08:47,402 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0006_01_000003 to application application_1423785972183_0006
2015-02-12 16:08:47,403 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0006 transitioned from INITING to RUNNING
2015-02-12 16:08:47,403 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:47,403 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 16:08:47,403 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0006
2015-02-12 16:08:47,403 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0006
2015-02-12 16:08:47,404 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:47,404 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0006
2015-02-12 16:08:47,404 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:08:47,405 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:08:47,405 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0006_01_000003
2015-02-12 16:08:47,435 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423785972183_0006_01_000003.tokens. Credentials list: 
2015-02-12 16:08:47,435 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60568 for container : container_1423785972183_0007_01_000002
2015-02-12 16:08:47,436 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:47,436 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60564 for container : container_1423785972183_0007_01_000003
2015-02-12 16:08:47,436 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:47,488 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:47,488 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:47,519 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:47,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,616 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,633 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:08:47,682 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000002/default_container_executor.sh]
2015-02-12 16:08:47,731 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0007_000001 (auth:SIMPLE)
2015-02-12 16:08:47,746 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0007_01_000002 by user soberoi
2015-02-12 16:08:47,746 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000002
2015-02-12 16:08:47,747 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0007_01_000002 to application application_1423785972183_0007
2015-02-12 16:08:47,747 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 16:08:47,747 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0007
2015-02-12 16:08:47,747 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0007
2015-02-12 16:08:47,747 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:47,747 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0007
2015-02-12 16:08:47,748 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:47,755 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0007_000001 (auth:SIMPLE)
2015-02-12 16:08:47,772 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0007_01_000003 by user soberoi
2015-02-12 16:08:47,773 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0007
2015-02-12 16:08:47,773 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000003
2015-02-12 16:08:47,773 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0007 transitioned from NEW to INITING
2015-02-12 16:08:47,773 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0007_01_000003 to application application_1423785972183_0007
2015-02-12 16:08:47,773 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0007 transitioned from INITING to RUNNING
2015-02-12 16:08:47,774 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 16:08:47,774 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0007
2015-02-12 16:08:47,774 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0007
2015-02-12 16:08:47,774 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:47,774 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0007
2015-02-12 16:08:47,774 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:08:47,774 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:08:47,775 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0007_01_000003
2015-02-12 16:08:47,798 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423785972183_0007_01_000003.tokens. Credentials list: 
2015-02-12 16:08:47,812 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:47,812 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:47,813 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423785972183_0006_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000003.tokens
2015-02-12 16:08:47,813 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0006
2015-02-12 16:08:47,908 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:47,908 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:47,908 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000004
2015-02-12 16:08:47,908 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0007_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 16:08:47,945 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:47,945 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:47,946 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000004
2015-02-12 16:08:47,946 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0006_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 16:08:47,960 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:47,961 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:47,961 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000005
2015-02-12 16:08:47,961 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0007_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 16:08:47,961 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:47,962 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:47,962 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000005
2015-02-12 16:08:47,962 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0006_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 16:08:47,968 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:47,992 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:08:48,019 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000002/default_container_executor.sh]
2015-02-12 16:08:48,046 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0006/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:08:48,074 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741886_1062
2015-02-12 16:08:48,075 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741885_1061
2015-02-12 16:08:48,077 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741884_1060
2015-02-12 16:08:48,085 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:48,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:48,145 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0006/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:08:48,145 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:48,180 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423785972183_0007_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000003.tokens
2015-02-12 16:08:48,180 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0007
2015-02-12 16:08:48,201 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:48,201 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:48,232 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:48,232 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:48,243 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0006_000001 (auth:SIMPLE)
2015-02-12 16:08:48,244 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0006_000001 (auth:SIMPLE)
2015-02-12 16:08:48,248 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0006_01_000004 by user soberoi
2015-02-12 16:08:48,248 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000004
2015-02-12 16:08:48,248 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0006_01_000005 by user soberoi
2015-02-12 16:08:48,249 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000005
2015-02-12 16:08:48,250 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0006_01_000005 to application application_1423785972183_0006
2015-02-12 16:08:48,250 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 16:08:48,250 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0006
2015-02-12 16:08:48,250 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0006
2015-02-12 16:08:48,250 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:48,251 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0006
2015-02-12 16:08:48,249 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0006_01_000004 to application application_1423785972183_0006
2015-02-12 16:08:48,251 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:48,252 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 16:08:48,252 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0006
2015-02-12 16:08:48,252 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0006
2015-02-12 16:08:48,252 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:48,252 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0006
2015-02-12 16:08:48,253 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:48,283 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741890_1066
2015-02-12 16:08:48,328 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:48,328 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:48,332 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:48,332 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:48,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:48,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:48,432 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0007/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:08:48,457 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:48,457 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:48,464 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741890_1066
2015-02-12 16:08:48,471 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0007_000001 (auth:SIMPLE)
2015-02-12 16:08:48,472 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0007_000001 (auth:SIMPLE)
2015-02-12 16:08:48,473 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0007_01_000004 by user soberoi
2015-02-12 16:08:48,474 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000004
2015-02-12 16:08:48,474 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0007_01_000004 to application application_1423785972183_0007
2015-02-12 16:08:48,474 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 16:08:48,474 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0007
2015-02-12 16:08:48,474 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0007
2015-02-12 16:08:48,474 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:48,475 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0007
2015-02-12 16:08:48,475 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0007_01_000005 by user soberoi
2015-02-12 16:08:48,475 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000005
2015-02-12 16:08:48,475 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:48,475 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0007_01_000005 to application application_1423785972183_0007
2015-02-12 16:08:48,476 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 16:08:48,476 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0007
2015-02-12 16:08:48,476 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0007
2015-02-12 16:08:48,476 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:48,476 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0007
2015-02-12 16:08:48,477 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0007_01_000005
2015-02-12 16:08:48,478 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741883_1059
2015-02-12 16:08:48,479 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741887_1063
2015-02-12 16:08:48,479 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741888_1064
2015-02-12 16:08:48,498 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423785972183_0007_01_000005.tokens. Credentials list: 
2015-02-12 16:08:48,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:48,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:48,515 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000003/default_container_executor.sh]
2015-02-12 16:08:48,530 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:48,554 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:48,554 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:48,588 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0007/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:08:48,589 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:48,589 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:48,595 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000005/default_container_executor.sh]
2015-02-12 16:08:48,596 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000004/default_container_executor.sh]
2015-02-12 16:08:48,672 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741883_1059
2015-02-12 16:08:48,673 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741885_1061
2015-02-12 16:08:48,673 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:48,673 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741887_1063
2015-02-12 16:08:48,673 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:48,676 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741889_1065
2015-02-12 16:08:48,685 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:48,685 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:48,866 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741884_1060
2015-02-12 16:08:48,867 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741888_1064
2015-02-12 16:08:48,867 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741886_1062
2015-02-12 16:08:48,905 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000004/default_container_executor.sh]
2015-02-12 16:08:48,912 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:48,912 INFO  fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423785972183_0007
2015-02-12 16:08:48,912 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000006 Container Transitioned from NEW to RESERVED
2015-02-12 16:08:48,913 INFO  fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423785972183_0007_01_000006 on node host: 10.1.1.67:60568 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@3eaf9a25
2015-02-12 16:08:48,946 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:48,946 INFO  fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423785972183_0007
2015-02-12 16:08:48,946 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000007 Container Transitioned from NEW to RESERVED
2015-02-12 16:08:48,947 INFO  fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423785972183_0007_01_000007 on node host: 10.1.1.67:60556 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@3eaf9a25
2015-02-12 16:08:48,963 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:48,963 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:48,964 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000008
2015-02-12 16:08:48,964 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0007_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 16:08:48,964 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:48,964 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:48,964 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000006
2015-02-12 16:08:48,964 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0006_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 16:08:48,976 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000005/default_container_executor.sh]
2015-02-12 16:08:48,980 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000003/default_container_executor.sh]
2015-02-12 16:08:49,088 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741890_1066
2015-02-12 16:08:49,089 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741889_1065
2015-02-12 16:08:49,236 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60564 for container : container_1423785972183_0006_01_000006
2015-02-12 16:08:49,237 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:49,245 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0006_000001 (auth:SIMPLE)
2015-02-12 16:08:49,247 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0006_01_000006 by user soberoi
2015-02-12 16:08:49,248 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0006
2015-02-12 16:08:49,248 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000006
2015-02-12 16:08:49,248 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0006 transitioned from NEW to INITING
2015-02-12 16:08:49,248 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0006_01_000006 to application application_1423785972183_0006
2015-02-12 16:08:49,248 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0006 transitioned from INITING to RUNNING
2015-02-12 16:08:49,249 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 16:08:49,249 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0006
2015-02-12 16:08:49,249 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0006
2015-02-12 16:08:49,249 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:49,249 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0006
2015-02-12 16:08:49,249 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:08:49,250 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:08:49,250 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0006_01_000006
2015-02-12 16:08:49,264 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423785972183_0006_01_000006.tokens. Credentials list: 
2015-02-12 16:08:49,470 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60560 for container : container_1423785972183_0007_01_000008
2015-02-12 16:08:49,471 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:49,481 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0007_000001 (auth:SIMPLE)
2015-02-12 16:08:49,483 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0007_01_000008 by user soberoi
2015-02-12 16:08:49,483 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0007
2015-02-12 16:08:49,484 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000008
2015-02-12 16:08:49,484 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0007 transitioned from NEW to INITING
2015-02-12 16:08:49,484 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0007_01_000008 to application application_1423785972183_0007
2015-02-12 16:08:49,484 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0007 transitioned from INITING to RUNNING
2015-02-12 16:08:49,485 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 16:08:49,485 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0007
2015-02-12 16:08:49,485 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0007
2015-02-12 16:08:49,485 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:08:49,485 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0007
2015-02-12 16:08:49,485 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:08:49,485 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:08:49,485 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0007_01_000008
2015-02-12 16:08:49,505 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423785972183_0007_01_000008.tokens. Credentials list: 
2015-02-12 16:08:49,536 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:49,623 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:08:49,680 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:08:49,773 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1423785972183_0006_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000006.tokens
2015-02-12 16:08:49,773 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0006
2015-02-12 16:08:49,902 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423785972183_0007_01_000008.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000008.tokens
2015-02-12 16:08:49,902 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0007
2015-02-12 16:08:49,913 INFO  fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423785972183_0007_000001 on node host: 10.1.1.67:60568 #containers=3 available=0 used=4096
2015-02-12 16:08:49,913 INFO  fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423785972183_0007 unreserved  on node host: 10.1.1.67:60568 #containers=3 available=0 used=4096, currently has 1 at priority 20; currentReservation <memory:1024, vCores:1>
2015-02-12 16:08:49,913 INFO  fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423785972183_0007
2015-02-12 16:08:49,913 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000009 Container Transitioned from NEW to RESERVED
2015-02-12 16:08:49,913 INFO  fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423785972183_0007_01_000009 on node host: 10.1.1.67:60568 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@3eaf9a25
2015-02-12 16:08:49,947 INFO  fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423785972183_0007_000001 on node host: 10.1.1.67:60556 #containers=3 available=0 used=4096
2015-02-12 16:08:49,947 INFO  fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423785972183_0007 unreserved  on node host: 10.1.1.67:60556 #containers=3 available=0 used=4096, currently has 1 at priority 20; currentReservation <memory:1024, vCores:1>
2015-02-12 16:08:49,948 INFO  fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423785972183_0007
2015-02-12 16:08:49,948 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000010 Container Transitioned from NEW to RESERVED
2015-02-12 16:08:49,948 INFO  fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423785972183_0007_01_000010 on node host: 10.1.1.67:60556 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@3eaf9a25
2015-02-12 16:08:49,965 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:49,965 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000011 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:49,965 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000011
2015-02-12 16:08:49,965 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0007_01_000011 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 16:08:49,965 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:08:49,966 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:08:49,966 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000007
2015-02-12 16:08:49,966 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0006_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 16:08:49,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:49,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:50,058 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0006/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:08:50,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:50,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:50,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:50,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:08:50,211 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0006/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:08:50,212 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:50,226 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0007/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:08:50,241 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 16:08:50,242 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:50,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:50,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:08:50,272 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:50,272 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:50,320 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0007/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:08:50,320 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:08:50,367 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 16:08:50,367 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:08:50,453 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000006/default_container_executor.sh]
2015-02-12 16:08:50,478 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 16:08:50,478 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000011 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:08:50,548 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:50,586 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000008/default_container_executor.sh]
2015-02-12 16:08:50,914 INFO  fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423785972183_0007_000001 on node host: 10.1.1.67:60568 #containers=3 available=0 used=4096
2015-02-12 16:08:50,915 INFO  fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423785972183_0007 unreserved  on node host: 10.1.1.67:60568 #containers=3 available=0 used=4096, currently has 1 at priority 20; currentReservation <memory:1024, vCores:1>
2015-02-12 16:08:50,948 INFO  fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423785972183_0007_000001 on node host: 10.1.1.67:60556 #containers=3 available=0 used=4096
2015-02-12 16:08:50,948 INFO  fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423785972183_0007 unreserved  on node host: 10.1.1.67:60556 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 16:08:51,248 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000007 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:08:51,248 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0006_01_000007 in state: RELEASED event:RELEASED
2015-02-12 16:08:51,249 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000007
2015-02-12 16:08:51,249 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0006_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 16:08:51,249 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0006_000001 released container container_1423785972183_0006_01_000007 on node: host: 10.1.1.67:60564 #containers=3 available=1024 used=3072 with event: RELEASED
2015-02-12 16:08:51,252 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:08:51,423 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1423785972183_0007_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000005.tokens
2015-02-12 16:08:51,423 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0007
2015-02-12 16:08:51,490 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000011 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:08:51,490 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0007_01_000011 in state: RELEASED event:RELEASED
2015-02-12 16:08:51,490 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000011
2015-02-12 16:08:51,490 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0007_01_000011 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 16:08:51,490 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0007_000001 released container container_1423785972183_0007_01_000011 on node: host: 10.1.1.67:60560 #containers=3 available=1024 used=3072 with event: RELEASED
2015-02-12 16:08:51,552 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:51,969 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0006_01_000007
2015-02-12 16:08:51,969 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0007_01_000011
2015-02-12 16:08:52,555 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:53,559 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:53,690 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741891_1067
2015-02-12 16:08:53,691 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741893_1069
2015-02-12 16:08:53,875 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741892_1068
2015-02-12 16:08:53,876 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741891_1067
2015-02-12 16:08:53,877 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741894_1070
2015-02-12 16:08:54,095 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741894_1070
2015-02-12 16:08:54,096 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741892_1068
2015-02-12 16:08:54,097 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741891_1067
2015-02-12 16:08:54,097 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741893_1069
2015-02-12 16:08:54,564 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:54,591 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741894_1070
2015-02-12 16:08:54,591 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741893_1069
2015-02-12 16:08:54,592 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741892_1068
2015-02-12 16:08:55,566 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:56,572 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:56,697 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30010 milliseconds
2015-02-12 16:08:56,698 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 1 millisecond(s).
2015-02-12 16:08:57,583 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:58,593 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:08:59,600 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:09:00,611 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:09:01,618 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:09:02,624 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:09:03,629 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:09:04,638 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:09:05,640 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:09:06,645 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:09:06,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:07,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:07,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:07,636 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:07,646 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:09:07,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:07,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:07,881 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:08,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:08,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:08,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:08,424 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:08,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:08,648 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(205)) - testing if running
2015-02-12 16:09:08,656 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:08,693 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:08,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:08,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:08,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:08,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:09,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7482073258_lower_F9E2D12CA1944B3185799628339D0F4A/_temporary/1/_temporary/attempt_1423785972183_0006_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:09,554 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0006_000001 (auth:SIMPLE)
2015-02-12 16:09:09,556 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0006_01_000002
2015-02-12 16:09:09,556 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000002
2015-02-12 16:09:09,556 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000002 transitioned from RUNNING to KILLING
2015-02-12 16:09:09,557 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0006_01_000002
2015-02-12 16:09:09,574 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job_1423785972183_0006_1.jhist. BP-2102022600-10.1.1.67-1423785955551 blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]}
2015-02-12 16:09:09,577 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0006_01_000002 is : 143
2015-02-12 16:09:09,577 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741895_1071 src: /127.0.0.1:61367 dest: /127.0.0.1:60511
2015-02-12 16:09:09,579 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741895_1071 src: /127.0.0.1:61368 dest: /127.0.0.1:60515
2015-02-12 16:09:09,580 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741895_1071 src: /127.0.0.1:61369 dest: /127.0.0.1:60518
2015-02-12 16:09:09,585 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job_1423785972183_0006_1.jhist for DFSClient_NONMAPREDUCE_-1681212327_1
2015-02-12 16:09:09,587 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:09,593 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000002
2015-02-12 16:09:09,594 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000002
2015-02-12 16:09:09,594 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000002
2015-02-12 16:09:09,594 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000002
2015-02-12 16:09:09,593 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4259973568_upper_10F8FBFD2CC24F979486B9035D85B234/_temporary/1/_temporary/attempt_1423785972183_0007_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:09,595 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000002
2015-02-12 16:09:09,594 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:09,596 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0006_01_000002 from application application_1423785972183_0006
2015-02-12 16:09:09,596 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:09,596 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0006
2015-02-12 16:09:09,632 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0007_000001 (auth:SIMPLE)
2015-02-12 16:09:09,634 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0007_01_000002
2015-02-12 16:09:09,634 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000002
2015-02-12 16:09:09,634 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000002 transitioned from RUNNING to KILLING
2015-02-12 16:09:09,634 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0007_01_000002
2015-02-12 16:09:09,654 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:testStop(237)) - calling stop
2015-02-12 16:09:09,654 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] stopping all jobs
2015-02-12 16:09:09,654 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:call(230)) - calling complete
2015-02-12 16:09:09,656 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (3/3) ...-mr1/flowplatform/stopped
2015-02-12 16:09:09,657 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (2/3)
2015-02-12 16:09:09,662 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0007_01_000002 is : 143
2015-02-12 16:09:09,667 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job_1423785972183_0007_1.jhist. BP-2102022600-10.1.1.67-1423785955551 blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]}
2015-02-12 16:09:09,669 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741896_1072 src: /127.0.0.1:61372 dest: /127.0.0.1:60521
2015-02-12 16:09:09,671 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741896_1072 src: /127.0.0.1:61373 dest: /127.0.0.1:60515
2015-02-12 16:09:09,673 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741896_1072 src: /127.0.0.1:61374 dest: /127.0.0.1:60518
2015-02-12 16:09:09,677 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:09,677 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000002
2015-02-12 16:09:09,677 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000002
2015-02-12 16:09:09,678 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000002
2015-02-12 16:09:09,678 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000002
2015-02-12 16:09:09,678 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:09,678 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000002
2015-02-12 16:09:09,679 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0007_01_000002 from application application_1423785972183_0007
2015-02-12 16:09:09,679 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:09,679 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0007
2015-02-12 16:09:09,681 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job_1423785972183_0007_1.jhist for DFSClient_NONMAPREDUCE_-1007363385_1
2015-02-12 16:09:09,701 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0007_000001 (auth:SIMPLE)
2015-02-12 16:09:09,702 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0007_000001 (auth:SIMPLE)
2015-02-12 16:09:09,705 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0007_01_000003
2015-02-12 16:09:09,706 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000003
2015-02-12 16:09:09,706 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000003 transitioned from RUNNING to KILLING
2015-02-12 16:09:09,707 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0007_01_000003
2015-02-12 16:09:09,708 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0007_000001 (auth:SIMPLE)
2015-02-12 16:09:09,710 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0007_000001 (auth:SIMPLE)
2015-02-12 16:09:09,729 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0007_01_000003 is : 143
2015-02-12 16:09:09,731 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0007_01_000005
2015-02-12 16:09:09,731 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000005
2015-02-12 16:09:09,731 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0007_01_000008
2015-02-12 16:09:09,731 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000008
2015-02-12 16:09:09,732 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000008 transitioned from RUNNING to KILLING
2015-02-12 16:09:09,732 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0007_01_000008
2015-02-12 16:09:09,739 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:09,740 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000005 transitioned from RUNNING to KILLING
2015-02-12 16:09:09,740 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000003
2015-02-12 16:09:09,740 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000003
2015-02-12 16:09:09,740 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000003
2015-02-12 16:09:09,741 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000003
2015-02-12 16:09:09,741 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0007_01_000005
2015-02-12 16:09:09,746 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0007_01_000004
2015-02-12 16:09:09,746 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000004
2015-02-12 16:09:09,746 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000004 transitioned from RUNNING to KILLING
2015-02-12 16:09:09,747 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0007_01_000004
2015-02-12 16:09:09,747 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:09,747 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0007_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 16:09:09,748 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000002
2015-02-12 16:09:09,748 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0007_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 16:09:09,748 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0007_000001 released container container_1423785972183_0007_01_000002 on node: host: 10.1.1.67:60568 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 16:09:09,752 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0007_01_000008 is : 143
2015-02-12 16:09:09,761 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0007_01_000005 is : 143
2015-02-12 16:09:09,764 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:09,765 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000008
2015-02-12 16:09:09,765 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:09,765 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0007_01_000008 from application application_1423785972183_0007
2015-02-12 16:09:09,765 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:09,765 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0007
2015-02-12 16:09:09,767 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000008
2015-02-12 16:09:09,767 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000008
2015-02-12 16:09:09,767 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000008
2015-02-12 16:09:09,768 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000008
2015-02-12 16:09:09,770 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0007_01_000004 is : 143
2015-02-12 16:09:09,770 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000003
2015-02-12 16:09:09,771 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:09,771 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:09,771 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0007_01_000003 from application application_1423785972183_0007
2015-02-12 16:09:09,771 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:09,771 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0007
2015-02-12 16:09:09,772 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000005
2015-02-12 16:09:09,772 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000005
2015-02-12 16:09:09,772 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:09,772 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0007_01_000005 from application application_1423785972183_0007
2015-02-12 16:09:09,772 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:09,772 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0007
2015-02-12 16:09:09,773 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000005
2015-02-12 16:09:09,773 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000005
2015-02-12 16:09:09,773 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000005
2015-02-12 16:09:09,778 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:09,778 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000004
2015-02-12 16:09:09,778 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000004
2015-02-12 16:09:09,778 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000004
2015-02-12 16:09:09,779 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000004
2015-02-12 16:09:09,779 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000004
2015-02-12 16:09:09,779 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:09,780 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0007_01_000004 from application application_1423785972183_0007
2015-02-12 16:09:09,795 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:09,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/4259973568_upper_10F8FBFD2CC24F979486B9035D85B234/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 16:09:09,797 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0007
2015-02-12 16:09:09,820 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61374, dest: /127.0.0.1:60518, bytes: 27633, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1007363385_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741896_1072, duration: 144387000
2015-02-12 16:09:09,820 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741896_1072, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:09,820 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]} size 16340
2015-02-12 16:09:09,821 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61373, dest: /127.0.0.1:60515, bytes: 27633, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1007363385_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741896_1072, duration: 144878000
2015-02-12 16:09:09,821 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741896_1072, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:09,823 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]} size 16340
2015-02-12 16:09:09,823 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61372, dest: /127.0.0.1:60521, bytes: 27633, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1007363385_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741896_1072, duration: 146526000
2015-02-12 16:09:09,823 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741896_1072, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:09,823 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 16340
2015-02-12 16:09:09,825 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job_1423785972183_0007_1.jhist is closed by DFSClient_NONMAPREDUCE_-1007363385_1
2015-02-12 16:09:09,830 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:09:09,833 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007.summary_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]}
2015-02-12 16:09:09,835 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741897_1073 src: /127.0.0.1:61379 dest: /127.0.0.1:60521
2015-02-12 16:09:09,838 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741897_1073 src: /127.0.0.1:61380 dest: /127.0.0.1:60515
2015-02-12 16:09:09,842 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741897_1073 src: /127.0.0.1:61381 dest: /127.0.0.1:60518
2015-02-12 16:09:09,845 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61381, dest: /127.0.0.1:60518, bytes: 412, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1007363385_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741897_1073, duration: 1605000
2015-02-12 16:09:09,845 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741897_1073, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:09,846 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]} size 0
2015-02-12 16:09:09,846 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61380, dest: /127.0.0.1:60515, bytes: 412, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1007363385_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741897_1073, duration: 2241000
2015-02-12 16:09:09,846 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741897_1073, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:09,847 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]} size 0
2015-02-12 16:09:09,847 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61379, dest: /127.0.0.1:60521, bytes: 412, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1007363385_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741897_1073, duration: 3245000
2015-02-12 16:09:09,847 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741897_1073, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:09,847 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]} size 0
2015-02-12 16:09:09,849 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1007363385_1
2015-02-12 16:09:09,853 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:09,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job_1423785972183_0007_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:09:09,860 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007-1423786118801-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2F41D842EC37914DCE-1423786149792-1-0-KILLED-root.soberoi-1423786125376.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:09:09,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7482073258_lower_F9E2D12CA1944B3185799628339D0F4A/_temporary/1/_temporary/attempt_1423785972183_0006_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:09,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job_1423785972183_0007_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:09:09,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007-1423786118801-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2F41D842EC37914DCE-1423786149792-1-0-KILLED-root.soberoi-1423786125376.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:09:09,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job_1423785972183_0007_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:09:09,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007-1423786118801-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2F41D842EC37914DCE-1423786149792-1-0-KILLED-root.soberoi-1423786125376.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:09:09,880 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007-1423786118801-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2F41D842EC37914DCE-1423786149792-1-0-KILLED-root.soberoi-1423786125376.jhist_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]}
2015-02-12 16:09:09,884 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741898_1074 src: /127.0.0.1:61383 dest: /127.0.0.1:60511
2015-02-12 16:09:09,885 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741898_1074 src: /127.0.0.1:61384 dest: /127.0.0.1:60521
2015-02-12 16:09:09,887 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741898_1074 src: /127.0.0.1:61385 dest: /127.0.0.1:60518
2015-02-12 16:09:09,890 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61385, dest: /127.0.0.1:60518, bytes: 27633, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1007363385_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741898_1074, duration: 1480000
2015-02-12 16:09:09,890 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741898_1074, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:09,891 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:09,891 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61384, dest: /127.0.0.1:60521, bytes: 27633, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1007363385_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741898_1074, duration: 2183000
2015-02-12 16:09:09,891 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741898_1074, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:09,892 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:09,892 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61383, dest: /127.0.0.1:60511, bytes: 27633, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1007363385_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741898_1074, duration: 3071000
2015-02-12 16:09:09,892 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741898_1074, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:09,892 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:09,894 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007-1423786118801-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2F41D842EC37914DCE-1423786149792-1-0-KILLED-root.soberoi-1423786125376.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1007363385_1
2015-02-12 16:09:09,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007-1423786118801-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2F41D842EC37914DCE-1423786149792-1-0-KILLED-root.soberoi-1423786125376.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:09,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job_1423785972183_0007_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:09,899 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:09:09,900 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job_1423785972183_0007_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:09,902 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:09:09,914 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0006_000001 (auth:SIMPLE)
2015-02-12 16:09:09,916 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0006_01_000005
2015-02-12 16:09:09,916 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000005
2015-02-12 16:09:09,917 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:09,917 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0007_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 16:09:09,917 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000008
2015-02-12 16:09:09,917 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0007_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 16:09:09,917 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0007_000001 released container container_1423785972183_0007_01_000008 on node: host: 10.1.1.67:60560 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 16:09:09,917 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000005 transitioned from RUNNING to KILLING
2015-02-12 16:09:09,917 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0006_01_000005
2015-02-12 16:09:09,939 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0006_01_000005 is : 143
2015-02-12 16:09:09,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:09,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007/job_1423785972183_0007_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:09,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:09:09,975 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:09,976 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000005
2015-02-12 16:09:09,978 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000005
2015-02-12 16:09:09,978 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000005
2015-02-12 16:09:09,982 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000005
2015-02-12 16:09:09,983 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000005
2015-02-12 16:09:09,983 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:09,985 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0006_01_000005 from application application_1423785972183_0006
2015-02-12 16:09:09,985 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:09,985 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0006
2015-02-12 16:09:09,989 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007_conf.xml_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]}
2015-02-12 16:09:09,991 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741899_1075 src: /127.0.0.1:61388 dest: /127.0.0.1:60511
2015-02-12 16:09:09,993 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741899_1075 src: /127.0.0.1:61389 dest: /127.0.0.1:60521
2015-02-12 16:09:09,994 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741899_1075 src: /127.0.0.1:61390 dest: /127.0.0.1:60518
2015-02-12 16:09:09,997 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61390, dest: /127.0.0.1:60518, bytes: 113219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1007363385_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741899_1075, duration: 1655000
2015-02-12 16:09:09,998 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741899_1075, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:09,998 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]} size 0
2015-02-12 16:09:09,998 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61389, dest: /127.0.0.1:60521, bytes: 113219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1007363385_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741899_1075, duration: 2321000
2015-02-12 16:09:09,998 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741899_1075, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:09,999 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]} size 0
2015-02-12 16:09:09,999 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61388, dest: /127.0.0.1:60511, bytes: 113219, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1007363385_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741899_1075, duration: 3172000
2015-02-12 16:09:09,999 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741899_1075, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:10,000 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:10,002 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1007363385_1
2015-02-12 16:09:10,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:10,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:10,020 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:10,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007-1423786118801-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2F41D842EC37914DCE-1423786149792-1-0-KILLED-root.soberoi-1423786125376.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007-1423786118801-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2F41D842EC37914DCE-1423786149792-1-0-KILLED-root.soberoi-1423786125376.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:10,040 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423785972183_0007_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 16:09:10,040 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0007_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 16:09:10,040 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423785972183_0007 with final state: FINISHING
2015-02-12 16:09:10,040 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0007 State change from RUNNING to FINAL_SAVING
2015-02-12 16:09:10,041 INFO  recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423785972183_0007
2015-02-12 16:09:10,042 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0007_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 16:09:10,042 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0007 State change from FINAL_SAVING to FINISHING
2015-02-12 16:09:10,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:10,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4259973568_upper_10F8FBFD2CC24F979486B9035D85B234/_temporary/1/_temporary/attempt_1423785972183_0007_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:10,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4259973568_upper_10F8FBFD2CC24F979486B9035D85B234/_temporary/1/_temporary/attempt_1423785972183_0007_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:10,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7482073258_lower_F9E2D12CA1944B3185799628339D0F4A/_temporary/1/_temporary/attempt_1423785972183_0006_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:10,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7482073258_lower_F9E2D12CA1944B3185799628339D0F4A/_temporary/1/_temporary/attempt_1423785972183_0006_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:10,407 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0006_000001 (auth:SIMPLE)
2015-02-12 16:09:10,409 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0006_01_000004
2015-02-12 16:09:10,410 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000004
2015-02-12 16:09:10,410 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000004 transitioned from RUNNING to KILLING
2015-02-12 16:09:10,410 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0006_01_000004
2015-02-12 16:09:10,411 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:10,411 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0006_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 16:09:10,412 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000002
2015-02-12 16:09:10,412 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0006_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 16:09:10,412 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0006_000001 released container container_1423785972183_0006_01_000002 on node: host: 10.1.1.67:60556 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 16:09:10,419 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0006_000001 (auth:SIMPLE)
2015-02-12 16:09:10,422 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0006_01_000003
2015-02-12 16:09:10,422 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000003
2015-02-12 16:09:10,424 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:10,424 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0006_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 16:09:10,424 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000005
2015-02-12 16:09:10,424 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0006_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 16:09:10,424 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0006_000001 released container container_1423785972183_0006_01_000005 on node: host: 10.1.1.67:60560 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 16:09:10,424 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:10,428 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000003 transitioned from RUNNING to KILLING
2015-02-12 16:09:10,429 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0006_01_000003
2015-02-12 16:09:10,433 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0006_01_000004 is : 143
2015-02-12 16:09:10,456 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0006_01_000003 is : 143
2015-02-12 16:09:10,463 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:10,464 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000004
2015-02-12 16:09:10,466 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000004
2015-02-12 16:09:10,467 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000004
2015-02-12 16:09:10,468 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000004
2015-02-12 16:09:10,468 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000004
2015-02-12 16:09:10,468 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:10,469 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0006_01_000004 from application application_1423785972183_0006
2015-02-12 16:09:10,469 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:10,469 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:10,469 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0006
2015-02-12 16:09:10,470 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000003
2015-02-12 16:09:10,470 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000003
2015-02-12 16:09:10,470 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000003
2015-02-12 16:09:10,469 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000003
2015-02-12 16:09:10,469 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000003
2015-02-12 16:09:10,470 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:10,471 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0006_01_000003 from application application_1423785972183_0006
2015-02-12 16:09:10,471 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:10,471 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0006
2015-02-12 16:09:10,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4259973568_upper_10F8FBFD2CC24F979486B9035D85B234/_temporary/1/_temporary/attempt_1423785972183_0007_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:10,689 INFO  hs.JobHistory (JobHistory.java:run(188)) - Starting scan to move intermediate done files
2015-02-12 16:09:10,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 16:09:10,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:09:10,695 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007.summary	dst=null	perm=null	proto=rpc
2015-02-12 16:09:10,698 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(372)) - jobId=job_1423785972183_0007,submitTime=1423786118801,launchTime=1423786125376,firstMapTaskLaunchTime=1423786127778,firstReduceTaskLaunchTime=0,finishTime=1423786149792,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=KILLED,mapSlotSeconds=106,reduceSlotSeconds=0,jobName=[EFFD47884A2A4392A7D7EEC2E1B7338A/41D842EC37914DCE90424C6AC2B4854B] lower*upper/(2/3)
2015-02-12 16:09:10,698 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(373)) - Deleting JobSummary file: [hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007.summary]
2015-02-12 16:09:10,699 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741897_1073 127.0.0.1:60521 127.0.0.1:60515 127.0.0.1:60518 
2015-02-12 16:09:10,700 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007.summary	dst=null	perm=null	proto=rpc
2015-02-12 16:09:10,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000	dst=null	perm=null	proto=rpc
2015-02-12 16:09:10,702 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007-1423786118801-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2F41D842EC37914DCE-1423786149792-1-0-KILLED-root.soberoi-1423786125376.jhist to hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0007-1423786118801-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2F41D842EC37914DCE-1423786149792-1-0-KILLED-root.soberoi-1423786125376.jhist
2015-02-12 16:09:10,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007-1423786118801-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2F41D842EC37914DCE-1423786149792-1-0-KILLED-root.soberoi-1423786125376.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0007-1423786118801-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2F41D842EC37914DCE-1423786149792-1-0-KILLED-root.soberoi-1423786125376.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:10,704 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(947)) - Moving hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007_conf.xml to hdfs://localhost:60510/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0007_conf.xml
2015-02-12 16:09:10,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0007_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/02/12/000000/job_1423785972183_0007_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:10,740 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:10,741 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0007_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 16:09:10,741 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000003
2015-02-12 16:09:10,741 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0007_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 16:09:10,741 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0007_000001 released container container_1423785972183_0007_01_000003 on node: host: 10.1.1.67:60564 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 16:09:10,741 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:10,741 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0007_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 16:09:10,741 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000005
2015-02-12 16:09:10,741 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0007_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 16:09:10,741 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0007_000001 released container container_1423785972183_0007_01_000005 on node: host: 10.1.1.67:60564 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 16:09:10,755 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:10,756 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:10,756 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0007_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 16:09:10,756 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000004
2015-02-12 16:09:10,756 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0007_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 16:09:10,756 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0007_000001 released container container_1423785972183_0007_01_000004 on node: host: 10.1.1.67:60568 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 16:09:10,843 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4259973568_upper_10F8FBFD2CC24F979486B9035D85B234/_temporary/1/_temporary/attempt_1423785972183_0007_m_000004_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:10,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/7482073258_lower_F9E2D12CA1944B3185799628339D0F4A/_temporary/1/_temporary/attempt_1423785972183_0006_m_000004_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:10,885 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0006_000001 (auth:SIMPLE)
2015-02-12 16:09:10,886 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0006_01_000006
2015-02-12 16:09:10,887 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000006
2015-02-12 16:09:10,887 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000006 transitioned from RUNNING to KILLING
2015-02-12 16:09:10,887 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0006_01_000006
2015-02-12 16:09:10,888 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:10,888 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:10,909 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0006_01_000006 is : 143
2015-02-12 16:09:10,923 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:10,924 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000006
2015-02-12 16:09:10,925 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000006
2015-02-12 16:09:10,926 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000006
2015-02-12 16:09:10,927 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000006
2015-02-12 16:09:10,927 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000006
2015-02-12 16:09:10,928 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:10,928 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0006_01_000006 from application application_1423785972183_0006
2015-02-12 16:09:10,928 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:10,928 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0006
2015-02-12 16:09:11,047 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423785972183_0007 unregistered successfully. 
2015-02-12 16:09:11,051 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741884_1060 127.0.0.1:60521 127.0.0.1:60515 127.0.0.1:60518 127.0.0.1:60511 
2015-02-12 16:09:11,051 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741886_1062 127.0.0.1:60521 127.0.0.1:60515 127.0.0.1:60511 127.0.0.1:60518 
2015-02-12 16:09:11,052 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741888_1064 127.0.0.1:60515 127.0.0.1:60511 127.0.0.1:60521 
2015-02-12 16:09:11,052 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741890_1066 127.0.0.1:60511 127.0.0.1:60518 127.0.0.1:60515 
2015-02-12 16:09:11,052 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741894_1070 127.0.0.1:60521 127.0.0.1:60518 127.0.0.1:60511 
2015-02-12 16:09:11,052 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741896_1072 127.0.0.1:60521 127.0.0.1:60515 127.0.0.1:60518 
2015-02-12 16:09:11,052 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741892_1068 127.0.0.1:60511 127.0.0.1:60518 127.0.0.1:60521 
2015-02-12 16:09:11,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0007	dst=null	perm=null	proto=rpc
2015-02-12 16:09:11,076 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/fail	dst=null	perm=null	proto=rpc
2015-02-12 16:09:11,414 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:11,414 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:11,414 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0006_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 16:09:11,414 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000004
2015-02-12 16:09:11,414 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0006_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 16:09:11,415 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0006_000001 released container container_1423785972183_0006_01_000004 on node: host: 10.1.1.67:60556 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 16:09:11,415 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:09:11,415 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000008
2015-02-12 16:09:11,416 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0006_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 16:09:11,431 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:11,432 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0006_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 16:09:11,432 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000003
2015-02-12 16:09:11,432 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0006_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 16:09:11,432 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0006_000001 released container container_1423785972183_0006_01_000003 on node: host: 10.1.1.67:60560 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 16:09:11,432 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:11,433 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:11,763 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:11,764 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:11,799 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (1/3)
2015-02-12 16:09:11,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/7482073258_lower_F9E2D12CA1944B3185799628339D0F4A/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 16:09:11,832 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61369, dest: /127.0.0.1:60518, bytes: 48204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1681212327_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741895_1071, duration: 2250449000
2015-02-12 16:09:11,833 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741895_1071, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:11,836 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]} size 16349
2015-02-12 16:09:11,837 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61368, dest: /127.0.0.1:60515, bytes: 48204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1681212327_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741895_1071, duration: 2254413000
2015-02-12 16:09:11,838 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741895_1071, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:11,838 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]} size 16349
2015-02-12 16:09:11,839 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61367, dest: /127.0.0.1:60511, bytes: 48204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1681212327_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741895_1071, duration: 2256568000
2015-02-12 16:09:11,839 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741895_1071, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:11,840 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW]]} size 16349
2015-02-12 16:09:11,843 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job_1423785972183_0006_1.jhist is closed by DFSClient_NONMAPREDUCE_-1681212327_1
2015-02-12 16:09:11,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:09:11,851 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006.summary_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]}
2015-02-12 16:09:11,853 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741900_1076 src: /127.0.0.1:61404 dest: /127.0.0.1:60515
2015-02-12 16:09:11,855 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741900_1076 src: /127.0.0.1:61405 dest: /127.0.0.1:60511
2015-02-12 16:09:11,858 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741900_1076 src: /127.0.0.1:61406 dest: /127.0.0.1:60521
2015-02-12 16:09:11,862 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61406, dest: /127.0.0.1:60521, bytes: 412, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1681212327_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741900_1076, duration: 2761000
2015-02-12 16:09:11,863 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741900_1076, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:11,864 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61405, dest: /127.0.0.1:60511, bytes: 412, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1681212327_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741900_1076, duration: 3932000
2015-02-12 16:09:11,864 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741900_1076, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:11,864 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:11,866 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61404, dest: /127.0.0.1:60515, bytes: 412, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1681212327_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741900_1076, duration: 4867000
2015-02-12 16:09:11,866 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741900_1076, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:11,866 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:11,868 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741900_1076 size 412
2015-02-12 16:09:11,869 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1681212327_1
2015-02-12 16:09:11,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:11,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job_1423785972183_0006_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:09:11,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006-1423786118804-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2FF3565F0074E74972-1423786151810-5-0-KILLED-root.soberoi-1423786125224.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:09:11,885 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job_1423785972183_0006_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:09:11,887 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006-1423786118804-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2FF3565F0074E74972-1423786151810-5-0-KILLED-root.soberoi-1423786125224.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:09:11,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job_1423785972183_0006_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:09:11,889 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:11,889 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0006_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 16:09:11,889 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000006
2015-02-12 16:09:11,890 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0006_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 16:09:11,890 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0006_000001 released container container_1423785972183_0006_01_000006 on node: host: 10.1.1.67:60564 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 16:09:11,890 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:11,890 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:11,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006-1423786118804-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2FF3565F0074E74972-1423786151810-5-0-KILLED-root.soberoi-1423786125224.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:09:11,898 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006-1423786118804-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2FF3565F0074E74972-1423786151810-5-0-KILLED-root.soberoi-1423786125224.jhist_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]}
2015-02-12 16:09:11,901 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741901_1077 src: /127.0.0.1:61408 dest: /127.0.0.1:60518
2015-02-12 16:09:11,902 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741901_1077 src: /127.0.0.1:61409 dest: /127.0.0.1:60511
2015-02-12 16:09:11,903 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60511 to delete [blk_1073741888_1064, blk_1073741890_1066, blk_1073741892_1068, blk_1073741894_1070, blk_1073741884_1060, blk_1073741886_1062]
2015-02-12 16:09:11,903 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60521 to delete [blk_1073741888_1064, blk_1073741892_1068, blk_1073741894_1070, blk_1073741896_1072, blk_1073741897_1073, blk_1073741884_1060, blk_1073741886_1062]
2015-02-12 16:09:11,904 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741901_1077 src: /127.0.0.1:61410 dest: /127.0.0.1:60521
2015-02-12 16:09:11,907 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61410, dest: /127.0.0.1:60521, bytes: 48204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1681212327_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741901_1077, duration: 1850000
2015-02-12 16:09:11,907 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741901_1077, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:11,908 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]} size 0
2015-02-12 16:09:11,908 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61409, dest: /127.0.0.1:60511, bytes: 48204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1681212327_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741901_1077, duration: 2342000
2015-02-12 16:09:11,908 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741901_1077, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:11,909 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]} size 0
2015-02-12 16:09:11,909 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61408, dest: /127.0.0.1:60518, bytes: 48204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1681212327_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741901_1077, duration: 3326000
2015-02-12 16:09:11,909 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741901_1077, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:11,910 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]} size 0
2015-02-12 16:09:11,912 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006-1423786118804-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2FF3565F0074E74972-1423786151810-5-0-KILLED-root.soberoi-1423786125224.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1681212327_1
2015-02-12 16:09:11,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006-1423786118804-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2FF3565F0074E74972-1423786151810-5-0-KILLED-root.soberoi-1423786125224.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:11,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job_1423785972183_0006_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:11,918 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:09:11,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job_1423785972183_0006_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:11,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:09:11,921 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006/job_1423785972183_0006_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:11,924 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:09:11,928 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006_conf.xml_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]}
2015-02-12 16:09:11,931 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741902_1078 src: /127.0.0.1:61412 dest: /127.0.0.1:60511
2015-02-12 16:09:11,933 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741902_1078 src: /127.0.0.1:61413 dest: /127.0.0.1:60518
2015-02-12 16:09:11,934 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741902_1078 src: /127.0.0.1:61414 dest: /127.0.0.1:60521
2015-02-12 16:09:11,937 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61414, dest: /127.0.0.1:60521, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1681212327_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741902_1078, duration: 1914000
2015-02-12 16:09:11,938 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741902_1078, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:11,938 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:11,938 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61413, dest: /127.0.0.1:60518, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1681212327_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741902_1078, duration: 2618000
2015-02-12 16:09:11,939 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741902_1078, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:11,939 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:11,939 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61412, dest: /127.0.0.1:60511, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1681212327_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741902_1078, duration: 3549000
2015-02-12 16:09:11,940 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741902_1078, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:11,940 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:11,942 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1681212327_1
2015-02-12 16:09:11,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:11,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:11,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:11,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006-1423786118804-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2FF3565F0074E74972-1423786151810-5-0-KILLED-root.soberoi-1423786125224.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0006-1423786118804-soberoi-%5BEFFD47884A2A4392A7D7EEC2E1B7338A%2FF3565F0074E74972-1423786151810-5-0-KILLED-root.soberoi-1423786125224.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:11,971 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423785972183_0006_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 16:09:11,972 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0006_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 16:09:11,972 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423785972183_0006 with final state: FINISHING
2015-02-12 16:09:11,972 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0006 State change from RUNNING to FINAL_SAVING
2015-02-12 16:09:11,972 INFO  recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423785972183_0006
2015-02-12 16:09:11,972 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0006_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 16:09:11,972 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0006 State change from FINAL_SAVING to FINISHING
2015-02-12 16:09:12,424 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:12,425 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:12,438 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:12,438 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:12,438 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:12,754 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741888 for deletion
2015-02-12 16:09:12,754 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741890 for deletion
2015-02-12 16:09:12,754 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741892 for deletion
2015-02-12 16:09:12,755 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741894 for deletion
2015-02-12 16:09:12,755 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741890
2015-02-12 16:09:12,755 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741888
2015-02-12 16:09:12,755 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741892
2015-02-12 16:09:12,756 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741894
2015-02-12 16:09:12,755 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741884 for deletion
2015-02-12 16:09:12,756 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741886 for deletion
2015-02-12 16:09:12,756 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741884
2015-02-12 16:09:12,757 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741886
2015-02-12 16:09:12,766 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:12,766 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:12,893 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:12,893 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:12,893 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:12,977 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423785972183_0006 unregistered successfully. 
2015-02-12 16:09:12,981 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741883_1059 127.0.0.1:60515 127.0.0.1:60518 127.0.0.1:60521 127.0.0.1:60511 
2015-02-12 16:09:12,982 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741885_1061 127.0.0.1:60518 127.0.0.1:60515 127.0.0.1:60521 127.0.0.1:60511 
2015-02-12 16:09:12,982 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741887_1063 127.0.0.1:60521 127.0.0.1:60511 127.0.0.1:60515 
2015-02-12 16:09:12,982 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741889_1065 127.0.0.1:60521 127.0.0.1:60515 127.0.0.1:60518 
2015-02-12 16:09:12,982 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741893_1069 127.0.0.1:60518 127.0.0.1:60521 127.0.0.1:60515 
2015-02-12 16:09:12,982 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741895_1071 127.0.0.1:60511 127.0.0.1:60515 127.0.0.1:60518 
2015-02-12 16:09:12,983 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741891_1067 127.0.0.1:60515 127.0.0.1:60511 127.0.0.1:60518 
2015-02-12 16:09:12,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0006	dst=null	perm=null	proto=rpc
2015-02-12 16:09:13,426 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:13,426 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:13,439 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:13,439 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:13,439 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:13,457 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741888 for deletion
2015-02-12 16:09:13,457 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741892 for deletion
2015-02-12 16:09:13,458 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741894 for deletion
2015-02-12 16:09:13,458 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741888
2015-02-12 16:09:13,458 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741896 for deletion
2015-02-12 16:09:13,459 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741897 for deletion
2015-02-12 16:09:13,459 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741884 for deletion
2015-02-12 16:09:13,459 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741892
2015-02-12 16:09:13,459 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741886 for deletion
2015-02-12 16:09:13,459 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741896
2015-02-12 16:09:13,459 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741894
2015-02-12 16:09:13,460 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741897
2015-02-12 16:09:13,461 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741884
2015-02-12 16:09:13,461 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741886
2015-02-12 16:09:13,767 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:13,767 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:13,829 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] stopped all jobs
2015-02-12 16:09:13,830 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] shutting down job executor
2015-02-12 16:09:13,863 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] abandoning step: (3/3) ...-mr1/flowplatform/stopped, predecessor failed: (1/3)
2015-02-12 16:09:13,864 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (3/3) ...-mr1/flowplatform/stopped
2015-02-12 16:09:13,864 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] abandoning step: (3/3) ...-mr1/flowplatform/stopped, predecessor failed: (2/3)
2015-02-12 16:09:13,864 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (3/3) ...-mr1/flowplatform/stopped
2015-02-12 16:09:13,867 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] shutdown complete
2015-02-12 16:09:13,868 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/flowplatform/stopped
2015-02-12 16:09:13,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/stopped	dst=null	perm=null	proto=rpc
2015-02-12 16:09:13,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:13,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:13,885 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 16:09:13,885 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 16:09:13,897 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:13,898 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:13,898 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:13,918 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(391)) - calling start
2015-02-12 16:09:13,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/STARTING/stopped	dst=null	perm=null	proto=rpc
2015-02-12 16:09:13,922 WARN  flow.Flow (BaseFlow.java:logWarn(1388)) - [lower*upper] flow listener cascading.flow.FailingFlowListener@4b9bb066 threw throwable
java.lang.RuntimeException: intentionally failed on: STARTING
	at cascading.flow.FailingFlowListener.onStarting(FailingFlowListener.java:45)
	at cascading.flow.BaseFlow$SafeFlowListener.onStarting(BaseFlow.java:1532)
	at cascading.flow.BaseFlow.fireOnStarting(BaseFlow.java:1358)
	at cascading.flow.BaseFlow.run(BaseFlow.java:1141)
	at cascading.flow.BaseFlow.access$100(BaseFlow.java:78)
	at cascading.flow.BaseFlow$1.run(BaseFlow.java:834)
	at java.lang.Thread.run(Thread.java:745)
2015-02-12 16:09:13,923 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] stopping all jobs
2015-02-12 16:09:13,923 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (3/3) ...platform/STARTING/stopped
2015-02-12 16:09:13,924 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (2/3)
2015-02-12 16:09:13,924 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (1/3)
2015-02-12 16:09:13,925 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] stopped all jobs
2015-02-12 16:09:13,925 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 16:09:13,925 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-02-12 16:09:13,925 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 16:09:13,925 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/STARTING/stopped"]
2015-02-12 16:09:13,925 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  parallel execution is enabled: true
2015-02-12 16:09:13,926 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  starting jobs: 3
2015-02-12 16:09:13,926 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  allocating threads: 3
2015-02-12 16:09:13,926 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/flowplatform/STARTING/stopped
2015-02-12 16:09:13,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/STARTING/stopped	dst=null	perm=null	proto=rpc
2015-02-12 16:09:13,928 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:13,942 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 16:09:13,943 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 16:09:13,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/startstop	dst=null	perm=null	proto=rpc
2015-02-12 16:09:13,956 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower] stopping all jobs
2015-02-12 16:09:13,958 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower] stopping: (1/1) ...r1/flowplatform/startstop
2015-02-12 16:09:13,958 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower] stopped all jobs
2015-02-12 16:09:13,959 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/flowplatform/startstop
2015-02-12 16:09:13,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/startstop	dst=null	perm=null	proto=rpc
2015-02-12 16:09:13,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:13,963 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:13,985 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 16:09:13,985 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 16:09:14,019 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(391)) - calling start
2015-02-12 16:09:14,020 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/STOPPING/stopped	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,022 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-02-12 16:09:14,022 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt"]
2015-02-12 16:09:14,022 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt"]
2015-02-12 16:09:14,022 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/STOPPING/stopped"]
2015-02-12 16:09:14,023 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  parallel execution is enabled: true
2015-02-12 16:09:14,023 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  starting jobs: 3
2015-02-12 16:09:14,023 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  allocating threads: 3
2015-02-12 16:09:14,022 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:14,036 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/3)
2015-02-12 16:09:14,045 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (2/3)
2015-02-12 16:09:14,055 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:60553
2015-02-12 16:09:14,072 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:60553
2015-02-12 16:09:14,085 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:60553
2015-02-12 16:09:14,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4876358366_upper_C3CE3554252F4FBBABE677233BD1E8A2	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,103 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 8
2015-02-12 16:09:14,105 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,106 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(690)) - Number of transactions: 628 Total time for transactions(ms): 55 Number of transactions batched in Syncs: 3 Number of syncs: 423 SyncTimes(ms): 154 110 
2015-02-12 16:09:14,107 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 16:09:14,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 16:09:14,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,110 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:09:14,112 INFO  client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at /10.1.1.67:60553
2015-02-12 16:09:14,112 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar. BP-2102022600-10.1.1.67-1423785955551 blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]}
2015-02-12 16:09:14,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/6106191911_lower_551D4F93DDA94A689A0CB5809239257F	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,116 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741903_1079 src: /127.0.0.1:61419 dest: /127.0.0.1:60521
2015-02-12 16:09:14,117 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,118 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741903_1079 src: /127.0.0.1:61420 dest: /127.0.0.1:60511
2015-02-12 16:09:14,118 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,119 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(250)) - Allocated new applicationId: 9
2015-02-12 16:09:14,119 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741903_1079 src: /127.0.0.1:61421 dest: /127.0.0.1:60515
2015-02-12 16:09:14,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009	dst=null	perm=soberoi:supergroup:rwxr-xr-x	proto=rpc
2015-02-12 16:09:14,128 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009	dst=null	perm=soberoi:supergroup:rwx------	proto=rpc
2015-02-12 16:09:14,129 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61421, dest: /127.0.0.1:60515, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741903_1079, duration: 6096000
2015-02-12 16:09:14,129 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741903_1079, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:14,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,130 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]} size 0
2015-02-12 16:09:14,130 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61420, dest: /127.0.0.1:60511, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741903_1079, duration: 6494000
2015-02-12 16:09:14,131 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741903_1079, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:14,131 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]} size 0
2015-02-12 16:09:14,132 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61419, dest: /127.0.0.1:60521, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741903_1079, duration: 9221000
2015-02-12 16:09:14,133 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741903_1079, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:14,134 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:09:14,136 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]} size 0
2015-02-12 16:09:14,138 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:09:14,139 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar. BP-2102022600-10.1.1.67-1423785955551 blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]}
2015-02-12 16:09:14,140 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar
2015-02-12 16:09:14,140 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,142 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741904_1080 src: /127.0.0.1:61422 dest: /127.0.0.1:60518
2015-02-12 16:09:14,143 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:09:14,144 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741904_1080 src: /127.0.0.1:61423 dest: /127.0.0.1:60521
2015-02-12 16:09:14,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,146 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741904_1080 src: /127.0.0.1:61424 dest: /127.0.0.1:60515
2015-02-12 16:09:14,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,149 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,153 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61424, dest: /127.0.0.1:60515, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741904_1080, duration: 5141000
2015-02-12 16:09:14,153 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741904_1080, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:14,154 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61423, dest: /127.0.0.1:60521, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741904_1080, duration: 5332000
2015-02-12 16:09:14,154 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741904_1080, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:14,156 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61422, dest: /127.0.0.1:60518, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741904_1080, duration: 7530000
2015-02-12 16:09:14,156 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741904_1080, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:14,156 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:14,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,158 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:14,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,159 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:14,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,160 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:09:14,161 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar
2015-02-12 16:09:14,161 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,162 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,162 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 16:09:14,163 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:09:14,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,165 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,166 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:09:14,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:09:14,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,169 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.split
2015-02-12 16:09:14,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,172 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.split. BP-2102022600-10.1.1.67-1423785955551 blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]}
2015-02-12 16:09:14,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,176 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741905_1081 src: /127.0.0.1:61425 dest: /127.0.0.1:60518
2015-02-12 16:09:14,179 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741905_1081 src: /127.0.0.1:61426 dest: /127.0.0.1:60511
2015-02-12 16:09:14,179 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,179 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(247)) - Total input paths to process : 1
2015-02-12 16:09:14,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,181 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741905_1081 src: /127.0.0.1:61427 dest: /127.0.0.1:60521
2015-02-12 16:09:14,183 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741905_1081 src: /127.0.0.1:61428 dest: /127.0.0.1:60515
2015-02-12 16:09:14,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:09:14,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:09:14,188 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2655)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.split
2015-02-12 16:09:14,189 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61428, dest: /127.0.0.1:60515, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741905_1081, duration: 3483000
2015-02-12 16:09:14,189 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741905_1081, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:14,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,190 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61427, dest: /127.0.0.1:60521, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741905_1081, duration: 3760000
2015-02-12 16:09:14,191 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741905_1081, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:14,191 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]} size 0
2015-02-12 16:09:14,191 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]} size 0
2015-02-12 16:09:14,192 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61426, dest: /127.0.0.1:60511, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741905_1081, duration: 5062000
2015-02-12 16:09:14,192 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741905_1081, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:14,194 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61425, dest: /127.0.0.1:60518, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741905_1081, duration: 7341000
2015-02-12 16:09:14,194 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741905_1081, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:14,195 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.split. BP-2102022600-10.1.1.67-1423785955551 blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]}
2015-02-12 16:09:14,197 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]} size 0
2015-02-12 16:09:14,200 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]} size 0
2015-02-12 16:09:14,201 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741906_1082 src: /127.0.0.1:61429 dest: /127.0.0.1:60511
2015-02-12 16:09:14,201 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.split is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:09:14,203 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741906_1082 src: /127.0.0.1:61430 dest: /127.0.0.1:60521
2015-02-12 16:09:14,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:09:14,206 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741906_1082 src: /127.0.0.1:61431 dest: /127.0.0.1:60515
2015-02-12 16:09:14,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:09:14,209 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.splitmetainfo. BP-2102022600-10.1.1.67-1423785955551 blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]}
2015-02-12 16:09:14,210 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741906_1082 src: /127.0.0.1:61432 dest: /127.0.0.1:60518
2015-02-12 16:09:14,212 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741907_1083 src: /127.0.0.1:61433 dest: /127.0.0.1:60518
2015-02-12 16:09:14,213 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741907_1083 src: /127.0.0.1:61434 dest: /127.0.0.1:60511
2015-02-12 16:09:14,214 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61432, dest: /127.0.0.1:60518, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741906_1082, duration: 2686000
2015-02-12 16:09:14,214 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741906_1082, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:14,215 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61431, dest: /127.0.0.1:60515, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741906_1082, duration: 2567000
2015-02-12 16:09:14,215 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741907_1083 src: /127.0.0.1:61435 dest: /127.0.0.1:60521
2015-02-12 16:09:14,215 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741906_1082, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:14,216 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61430, dest: /127.0.0.1:60521, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741906_1082, duration: 3754000
2015-02-12 16:09:14,216 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741906_1082, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:14,218 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61429, dest: /127.0.0.1:60511, bytes: 1787, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741906_1082, duration: 5690000
2015-02-12 16:09:14,219 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741906_1082, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:14,223 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:14,223 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:14,223 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:14,224 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:14,229 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61435, dest: /127.0.0.1:60521, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741907_1083, duration: 9276000
2015-02-12 16:09:14,230 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741907_1083, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:14,231 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61434, dest: /127.0.0.1:60511, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741907_1083, duration: 10637000
2015-02-12 16:09:14,231 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741907_1083, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:14,231 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]} size 0
2015-02-12 16:09:14,232 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]} size 0
2015-02-12 16:09:14,232 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61433, dest: /127.0.0.1:60518, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741907_1083, duration: 12576000
2015-02-12 16:09:14,233 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741907_1083, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:14,235 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]} size 0
2015-02-12 16:09:14,237 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:09:14,237 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.split is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:09:14,237 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 16:09:14,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:09:14,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:09:14,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:09:14,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:09:14,243 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.splitmetainfo. BP-2102022600-10.1.1.67-1423785955551 blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]}
2015-02-12 16:09:14,245 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741908_1084 src: /127.0.0.1:61436 dest: /127.0.0.1:60515
2015-02-12 16:09:14,246 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741908_1084 src: /127.0.0.1:61437 dest: /127.0.0.1:60511
2015-02-12 16:09:14,248 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741908_1084 src: /127.0.0.1:61438 dest: /127.0.0.1:60521
2015-02-12 16:09:14,249 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml. BP-2102022600-10.1.1.67-1423785955551 blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]}
2015-02-12 16:09:14,251 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741909_1085 src: /127.0.0.1:61439 dest: /127.0.0.1:60518
2015-02-12 16:09:14,251 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61438, dest: /127.0.0.1:60521, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741908_1084, duration: 1406000
2015-02-12 16:09:14,251 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741908_1084, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:14,252 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741909_1085 src: /127.0.0.1:61440 dest: /127.0.0.1:60511
2015-02-12 16:09:14,252 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61437, dest: /127.0.0.1:60511, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741908_1084, duration: 2051000
2015-02-12 16:09:14,253 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741908_1084, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:14,252 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:14,254 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61436, dest: /127.0.0.1:60515, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741908_1084, duration: 3465000
2015-02-12 16:09:14,254 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741908_1084, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:14,255 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741909_1085 src: /127.0.0.1:61441 dest: /127.0.0.1:60515
2015-02-12 16:09:14,256 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:14,258 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:14,260 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61441, dest: /127.0.0.1:60515, bytes: 96394, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741909_1085, duration: 2490000
2015-02-12 16:09:14,260 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:09:14,260 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741909_1085, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:14,260 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(492)) - number of splits:5
2015-02-12 16:09:14,261 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61440, dest: /127.0.0.1:60511, bytes: 96394, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741909_1085, duration: 2780000
2015-02-12 16:09:14,261 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741909_1085, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:14,262 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61439, dest: /127.0.0.1:60518, bytes: 96394, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741909_1085, duration: 3970000
2015-02-12 16:09:14,262 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741909_1085, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:14,264 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW]]} size 0
2015-02-12 16:09:14,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:09:14,265 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:14,265 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:14,268 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--	proto=rpc
2015-02-12 16:09:14,268 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:09:14,269 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423785972183_0008
2015-02-12 16:09:14,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,276 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml. BP-2102022600-10.1.1.67-1423785955551 blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW]]}
2015-02-12 16:09:14,276 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,278 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741910_1086 src: /127.0.0.1:61442 dest: /127.0.0.1:60515
2015-02-12 16:09:14,278 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,279 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741910_1086 src: /127.0.0.1:61443 dest: /127.0.0.1:60521
2015-02-12 16:09:14,279 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,282 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741910_1086 src: /127.0.0.1:61444 dest: /127.0.0.1:60511
2015-02-12 16:09:14,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,287 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61444, dest: /127.0.0.1:60511, bytes: 96394, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741910_1086, duration: 2010000
2015-02-12 16:09:14,287 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741910_1086, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:14,289 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61443, dest: /127.0.0.1:60521, bytes: 96394, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741910_1086, duration: 3231000
2015-02-12 16:09:14,290 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741910_1086, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:14,291 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61442, dest: /127.0.0.1:60515, bytes: 96394, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1457234308_9, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741910_1086, duration: 5567000
2015-02-12 16:09:14,292 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741910_1086, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:14,293 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:14,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,296 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:14,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,298 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741910_1086 size 96394
2015-02-12 16:09:14,298 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml is closed by DFSClient_NONMAPREDUCE_-1457234308_9
2015-02-12 16:09:14,298 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(575)) - Submitting tokens for job: job_1423785972183_0009
2015-02-12 16:09:14,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,302 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 8 submitted by user soberoi
2015-02-12 16:09:14,303 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi	IP=10.1.1.67	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423785972183_0008
2015-02-12 16:09:14,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,302 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423785972183_0008
2015-02-12 16:09:14,304 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0008 State change from NEW to NEW_SAVING
2015-02-12 16:09:14,304 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423785972183_0008
2015-02-12 16:09:14,304 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0008 State change from NEW_SAVING to SUBMITTED
2015-02-12 16:09:14,304 INFO  fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423785972183_0008 from user: soberoi, in queue: default, currently num of applications: 3
2015-02-12 16:09:14,305 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0008 State change from SUBMITTED to ACCEPTED
2015-02-12 16:09:14,305 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423785972183_0008_000001
2015-02-12 16:09:14,305 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0008_000001 State change from NEW to SUBMITTED
2015-02-12 16:09:14,305 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423785972183_0008
2015-02-12 16:09:14,305 INFO  fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423785972183_0008_000001 to scheduler from user: soberoi
2015-02-12 16:09:14,305 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0008_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 16:09:14,306 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,310 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,310 INFO  mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:60554/proxy/application_1423785972183_0008/
2015-02-12 16:09:14,310 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423785972183_0008
2015-02-12 16:09:14,310 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60554/proxy/application_1423785972183_0008/
2015-02-12 16:09:14,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,312 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,315 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,318 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,319 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,320 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(541)) - Application with id 9 submitted by user soberoi
2015-02-12 16:09:14,321 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi	IP=10.1.1.67	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1423785972183_0009
2015-02-12 16:09:14,320 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(968)) - Storing application with id application_1423785972183_0009
2015-02-12 16:09:14,321 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0009 State change from NEW to NEW_SAVING
2015-02-12 16:09:14,321 INFO  recovery.RMStateStore (RMStateStore.java:transition(136)) - Storing info for app: application_1423785972183_0009
2015-02-12 16:09:14,322 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0009 State change from NEW_SAVING to SUBMITTED
2015-02-12 16:09:14,322 INFO  fair.FairScheduler (FairScheduler.java:addApplication(622)) - Accepted application application_1423785972183_0009 from user: soberoi, in queue: default, currently num of applications: 4
2015-02-12 16:09:14,322 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0009 State change from SUBMITTED to ACCEPTED
2015-02-12 16:09:14,323 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(654)) - Registering app attempt : appattempt_1423785972183_0009_000001
2015-02-12 16:09:14,323 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0009_000001 State change from NEW to SUBMITTED
2015-02-12 16:09:14,323 INFO  fair.FairScheduler (FairScheduler.java:addApplicationAttempt(667)) - Added Application Attempt appattempt_1423785972183_0009_000001 to scheduler from user: soberoi
2015-02-12 16:09:14,323 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0009_000001 State change from SUBMITTED to SCHEDULED
2015-02-12 16:09:14,431 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:14,432 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:14,433 INFO  fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423785972183_0008
2015-02-12 16:09:14,433 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000001 Container Transitioned from NEW to RESERVED
2015-02-12 16:09:14,433 INFO  fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423785972183_0008_01_000001 on node host: 10.1.1.67:60556 #containers=2 available=1024 used=3072 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@53ee7656
2015-02-12 16:09:14,449 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:14,449 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:14,449 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:14,451 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:09:14,451 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000002
2015-02-12 16:09:14,451 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0008_01_000002 of capacity <memory:2048, vCores:1> on host 10.1.1.67:60560, which has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available after allocation
2015-02-12 16:09:14,451 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60560 for container : container_1423785972183_0008_01_000002
2015-02-12 16:09:14,452 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:09:14,452 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423785972183_0008_000001
2015-02-12 16:09:14,452 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423785972183_0008 AttemptId: appattempt_1423785972183_0008_000001 MasterContainer: Container: [ContainerId: container_1423785972183_0008_01_000002, NodeId: 10.1.1.67:60560, NodeHttpAddress: 10.1.1.67:60563, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60560 }, ]
2015-02-12 16:09:14,453 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0008_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 16:09:14,453 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0008_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 16:09:14,453 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423785972183_0008_000001
2015-02-12 16:09:14,454 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423785972183_0008_01_000002, NodeId: 10.1.1.67:60560, NodeHttpAddress: 10.1.1.67:60563, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60560 }, ] for AM appattempt_1423785972183_0008_000001
2015-02-12 16:09:14,454 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423785972183_0008_01_000002 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 16:09:14,454 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423785972183_0008_000001
2015-02-12 16:09:14,454 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423785972183_0008_000001
2015-02-12 16:09:14,457 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0008_000001 (auth:SIMPLE)
2015-02-12 16:09:14,459 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0008_01_000002 by user soberoi
2015-02-12 16:09:14,459 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0008
2015-02-12 16:09:14,459 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000002
2015-02-12 16:09:14,459 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0008 transitioned from NEW to INITING
2015-02-12 16:09:14,460 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0008_01_000002 to application application_1423785972183_0008
2015-02-12 16:09:14,460 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423785972183_0008_01_000002, NodeId: 10.1.1.67:60560, NodeHttpAddress: 10.1.1.67:60563, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60560 }, ] for AM appattempt_1423785972183_0008_000001
2015-02-12 16:09:14,460 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0008 transitioned from INITING to RUNNING
2015-02-12 16:09:14,460 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0008_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 16:09:14,460 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 16:09:14,460 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0008
2015-02-12 16:09:14,461 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:09:14,461 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 16:09:14,461 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.split transitioned from INIT to DOWNLOADING
2015-02-12 16:09:14,461 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:09:14,461 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0008_01_000002
2015-02-12 16:09:14,473 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423785972183_0008_01_000002.tokens. Credentials list: 
2015-02-12 16:09:14,530 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(236)) - Submitted application application_1423785972183_0009
2015-02-12 16:09:14,533 INFO  mapreduce.Job (Job.java:submit(1299)) - The url to track the job: http://Edinburgh.local:60554/proxy/application_1423785972183_0009/
2015-02-12 16:09:14,533 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1423785972183_0009
2015-02-12 16:09:14,533 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60554/proxy/application_1423785972183_0009/
2015-02-12 16:09:14,602 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:09:14,699 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1423785972183_0008_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000002.tokens
2015-02-12 16:09:14,699 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0008
2015-02-12 16:09:14,770 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:14,771 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:14,773 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000001 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:09:14,773 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000001
2015-02-12 16:09:14,774 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0009_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:60568, which has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available after allocation
2015-02-12 16:09:14,774 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60568 for container : container_1423785972183_0009_01_000001
2015-02-12 16:09:14,775 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:09:14,776 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:clearNodeSetForAttempt(146)) - Clear node set for appattempt_1423785972183_0009_000001
2015-02-12 16:09:14,776 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1845)) - Storing attempt: AppId: application_1423785972183_0009 AttemptId: appattempt_1423785972183_0009_000001 MasterContainer: Container: [ContainerId: container_1423785972183_0009_01_000001, NodeId: 10.1.1.67:60568, NodeHttpAddress: 10.1.1.67:60571, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60568 }, ]
2015-02-12 16:09:14,777 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0009_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-02-12 16:09:14,778 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0009_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-02-12 16:09:14,778 INFO  amlauncher.AMLauncher (AMLauncher.java:run(253)) - Launching masterappattempt_1423785972183_0009_000001
2015-02-12 16:09:14,780 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(106)) - Setting up container Container: [ContainerId: container_1423785972183_0009_01_000001, NodeId: 10.1.1.67:60568, NodeHttpAddress: 10.1.1.67:60571, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60568 }, ] for AM appattempt_1423785972183_0009_000001
2015-02-12 16:09:14,780 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(191)) - Command to launch container container_1423785972183_0009_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-02-12 16:09:14,780 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createAndGetAMRMToken(195)) - Create AMRMToken for ApplicationAttempt: appattempt_1423785972183_0009_000001
2015-02-12 16:09:14,780 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:createPassword(307)) - Creating password for appattempt_1423785972183_0009_000001
2015-02-12 16:09:14,783 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0009_000001 (auth:SIMPLE)
2015-02-12 16:09:14,787 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0009_01_000001 by user soberoi
2015-02-12 16:09:14,787 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0009
2015-02-12 16:09:14,787 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000001
2015-02-12 16:09:14,787 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0009 transitioned from NEW to INITING
2015-02-12 16:09:14,788 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0009_01_000001 to application application_1423785972183_0009
2015-02-12 16:09:14,788 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0009 transitioned from INITING to RUNNING
2015-02-12 16:09:14,788 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000001 transitioned from NEW to LOCALIZING
2015-02-12 16:09:14,788 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0009
2015-02-12 16:09:14,788 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:09:14,789 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-02-12 16:09:14,789 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.split transitioned from INIT to DOWNLOADING
2015-02-12 16:09:14,789 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:09:14,788 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(127)) - Done launching container Container: [ContainerId: container_1423785972183_0009_01_000001, NodeId: 10.1.1.67:60568, NodeHttpAddress: 10.1.1.67:60571, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.67:60568 }, ] for AM appattempt_1423785972183_0009_000001
2015-02-12 16:09:14,789 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0009_01_000001
2015-02-12 16:09:14,789 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0009_000001 State change from ALLOCATED to LAUNCHED
2015-02-12 16:09:14,799 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,801 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,804 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423785972183_0009_01_000001.tokens. Credentials list: 
2015-02-12 16:09:14,861 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0008/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:09:14,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,897 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:14,897 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:14,897 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:14,904 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:60515 to replicate blk_1073741903_1079 to datanode(s) 127.0.0.1:60518
2015-02-12 16:09:14,905 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1471)) - BLOCK* ask 127.0.0.1:60518 to replicate blk_1073741904_1080 to datanode(s) 127.0.0.1:60511
2015-02-12 16:09:14,905 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60515 to delete [blk_1073741888_1064, blk_1073741889_1065, blk_1073741890_1066, blk_1073741891_1067, blk_1073741893_1069, blk_1073741895_1071, blk_1073741896_1072, blk_1073741897_1073, blk_1073741883_1059, blk_1073741884_1060, blk_1073741885_1061, blk_1073741886_1062, blk_1073741887_1063]
2015-02-12 16:09:14,905 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60518 to delete [blk_1073741889_1065, blk_1073741890_1066, blk_1073741891_1067, blk_1073741892_1068, blk_1073741893_1069, blk_1073741894_1070, blk_1073741895_1071, blk_1073741896_1072, blk_1073741897_1073, blk_1073741883_1059, blk_1073741884_1060, blk_1073741885_1061, blk_1073741886_1062]
2015-02-12 16:09:14,945 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0008/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:09:14,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:14,989 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:09:15,029 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:15,036 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0008/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:09:15,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:15,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:15,112 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0008/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:09:15,112 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:09:15,121 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1423785972183_0009_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000001.tokens
2015-02-12 16:09:15,122 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0009
2015-02-12 16:09:15,156 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 16:09:15,156 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:15,232 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:15,235 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:15,294 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0009/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:09:15,298 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000002/default_container_executor.sh]
2015-02-12 16:09:15,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:09:15,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:09:15,369 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.splitmetainfo(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0009/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:09:15,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:15,401 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:15,434 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:15,434 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:15,434 INFO  fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423785972183_0008_000001 on node host: 10.1.1.67:60556 #containers=2 available=1024 used=3072
2015-02-12 16:09:15,434 INFO  fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423785972183_0008 unreserved  on node host: 10.1.1.67:60556 #containers=2 available=1024 used=3072, currently has 0 at priority 0; currentReservation <memory:0, vCores:0>
2015-02-12 16:09:15,444 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.split(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0009/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:09:15,450 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:09:15,450 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:15,450 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:15,451 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:15,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:15,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:15,535 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0009/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:09:15,536 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:09:15,597 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000001 transitioned from LOCALIZED to RUNNING
2015-02-12 16:09:15,597 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:15,722 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000001/default_container_executor.sh]
2015-02-12 16:09:15,762 INFO  datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=3ba35078-bb62-4777-80dc-a38267fd3486, infoPort=60516, ipcPort=60517, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0) Starting thread to transfer BP-2102022600-10.1.1.67-1423785955551:blk_1073741903_1079 to 127.0.0.1:60518 
2015-02-12 16:09:15,763 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741888 for deletion
2015-02-12 16:09:15,764 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741889 for deletion
2015-02-12 16:09:15,764 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741890 for deletion
2015-02-12 16:09:15,764 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741891 for deletion
2015-02-12 16:09:15,764 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741893 for deletion
2015-02-12 16:09:15,764 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741895_1071 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741895 for deletion
2015-02-12 16:09:15,764 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741896 for deletion
2015-02-12 16:09:15,764 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741897 for deletion
2015-02-12 16:09:15,764 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741883 for deletion
2015-02-12 16:09:15,764 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741884 for deletion
2015-02-12 16:09:15,765 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741885 for deletion
2015-02-12 16:09:15,765 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741886 for deletion
2015-02-12 16:09:15,765 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741887 for deletion
2015-02-12 16:09:15,765 INFO  datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-2102022600-10.1.1.67-1423785955551:blk_1073741903_1079 (numBytes=254067) to /127.0.0.1:60518
2015-02-12 16:09:15,765 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741889
2015-02-12 16:09:15,765 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741888
2015-02-12 16:09:15,766 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741891
2015-02-12 16:09:15,766 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741890
2015-02-12 16:09:15,766 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741903_1079 src: /127.0.0.1:61455 dest: /127.0.0.1:60518
2015-02-12 16:09:15,766 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741893
2015-02-12 16:09:15,766 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741895_1071 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741895
2015-02-12 16:09:15,767 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741897
2015-02-12 16:09:15,767 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741896
2015-02-12 16:09:15,767 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741883
2015-02-12 16:09:15,767 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741884
2015-02-12 16:09:15,768 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741886
2015-02-12 16:09:15,768 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741885
2015-02-12 16:09:15,769 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741887
2015-02-12 16:09:15,769 INFO  datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-2102022600-10.1.1.67-1423785955551:blk_1073741903_1079 src: /127.0.0.1:61455 dest: /127.0.0.1:60518 of size 254067
2015-02-12 16:09:15,771 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741903_1079 size 254067
2015-02-12 16:09:15,781 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:09:15,781 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:15,781 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:15,906 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:15,906 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:15,906 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:16,034 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:16,153 INFO  datanode.DataNode (DataNode.java:transferBlock(1845)) - DatanodeRegistration(127.0.0.1, datanodeUuid=1309dd03-96de-4536-9ff7-96af7fbd7a36, infoPort=60519, ipcPort=60520, storageInfo=lv=-56;cid=testClusterID;nsid=1086770231;c=0) Starting thread to transfer BP-2102022600-10.1.1.67-1423785955551:blk_1073741904_1080 to 127.0.0.1:60511 
2015-02-12 16:09:16,153 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741889 for deletion
2015-02-12 16:09:16,153 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741890 for deletion
2015-02-12 16:09:16,153 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741891 for deletion
2015-02-12 16:09:16,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741892 for deletion
2015-02-12 16:09:16,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741889
2015-02-12 16:09:16,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741893 for deletion
2015-02-12 16:09:16,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741894 for deletion
2015-02-12 16:09:16,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741895_1071 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741895 for deletion
2015-02-12 16:09:16,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741896 for deletion
2015-02-12 16:09:16,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741897 for deletion
2015-02-12 16:09:16,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741883 for deletion
2015-02-12 16:09:16,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741884 for deletion
2015-02-12 16:09:16,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741885 for deletion
2015-02-12 16:09:16,155 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741890
2015-02-12 16:09:16,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741891
2015-02-12 16:09:16,155 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741892
2015-02-12 16:09:16,155 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741904_1080 src: /127.0.0.1:61458 dest: /127.0.0.1:60511
2015-02-12 16:09:16,155 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741894
2015-02-12 16:09:16,155 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741886 for deletion
2015-02-12 16:09:16,156 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741896
2015-02-12 16:09:16,154 INFO  datanode.DataNode (DataNode.java:run(2050)) - DataTransfer: Transmitted BP-2102022600-10.1.1.67-1423785955551:blk_1073741904_1080 (numBytes=254067) to /127.0.0.1:60511
2015-02-12 16:09:16,156 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741884
2015-02-12 16:09:16,155 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741893
2015-02-12 16:09:16,156 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data5/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741886
2015-02-12 16:09:16,157 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741895_1071 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741895
2015-02-12 16:09:16,157 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741897
2015-02-12 16:09:16,157 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741883
2015-02-12 16:09:16,157 INFO  datanode.DataNode (DataXceiver.java:writeBlock(749)) - Received BP-2102022600-10.1.1.67-1423785955551:blk_1073741904_1080 src: /127.0.0.1:61458 dest: /127.0.0.1:60511 of size 254067
2015-02-12 16:09:16,158 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data6/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741885
2015-02-12 16:09:16,158 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741904_1080 size 254067
2015-02-12 16:09:16,164 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423785972183_0007_01_000001 succeeded 
2015-02-12 16:09:16,165 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 16:09:16,165 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0007_01_000001
2015-02-12 16:09:16,186 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000001
2015-02-12 16:09:16,186 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000001
2015-02-12 16:09:16,186 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000001
2015-02-12 16:09:16,187 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0007/container_1423785972183_0007_01_000001
2015-02-12 16:09:16,187 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000001
2015-02-12 16:09:16,187 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0007_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 16:09:16,188 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0007_01_000001 from application application_1423785972183_0007
2015-02-12 16:09:16,188 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:16,188 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0007
2015-02-12 16:09:16,437 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:16,437 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:16,455 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:16,455 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:16,455 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:16,783 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0007_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:16,783 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423785972183_0007_000001
2015-02-12 16:09:16,783 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0007_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 16:09:16,784 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000001
2015-02-12 16:09:16,784 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423785972183_0007_000001
2015-02-12 16:09:16,784 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0007_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:60568, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 16:09:16,784 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0007_000001 released container container_1423785972183_0007_01_000001 on node: host: 10.1.1.67:60568 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 16:09:16,784 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:16,784 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:16,784 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0007_000001 State change from FINISHING to FINISHED
2015-02-12 16:09:16,785 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0007 State change from FINISHING to FINISHED
2015-02-12 16:09:16,785 INFO  fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423785972183_0007_000001 is done. finalState=FINISHED
2015-02-12 16:09:16,785 INFO  amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423785972183_0007_000001
2015-02-12 16:09:16,785 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423785972183_0007 requests cleared
2015-02-12 16:09:16,785 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1423785972183_0007
2015-02-12 16:09:16,785 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423785972183_0007,name=[EFFD47884A2A4392A7D7EEC2E1B7338A/41D842EC37914DCE90424C6AC2B4854B] lower*upper/(2/3),user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:60554/proxy/application_1423785972183_0007/jobhistory/job/job_1423785972183_0007,appMasterHost=10.1.1.67,startTime=1423786118801,finishTime=1423786150040,finalStatus=KILLED
2015-02-12 16:09:16,787 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0007_000001 (auth:SIMPLE)
2015-02-12 16:09:16,789 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0007_01_000001
2015-02-12 16:09:16,789 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0007	CONTAINERID=container_1423785972183_0007_01_000001
2015-02-12 16:09:16,790 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0007_01_000001]
2015-02-12 16:09:16,790 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:16,790 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0007 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:09:16,790 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:16,790 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:16,790 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0007
2015-02-12 16:09:16,790 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0007
2015-02-12 16:09:16,791 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0007
2015-02-12 16:09:16,791 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0007
2015-02-12 16:09:16,791 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0007 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:09:16,791 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0007, with delay of 10800 seconds
2015-02-12 16:09:16,792 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0007
2015-02-12 16:09:16,910 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0007 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:09:16,910 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:16,911 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:16,911 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:16,911 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0007
2015-02-12 16:09:16,911 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0007
2015-02-12 16:09:16,912 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0007
2015-02-12 16:09:16,912 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0007 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:09:16,912 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0007, with delay of 10800 seconds
2015-02-12 16:09:16,912 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0007
2015-02-12 16:09:16,912 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0007
2015-02-12 16:09:17,046 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:17,439 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:17,440 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:17,459 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0007 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:09:17,459 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:17,459 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:17,459 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:17,459 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0007
2015-02-12 16:09:17,459 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0007
2015-02-12 16:09:17,460 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0007
2015-02-12 16:09:17,460 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0007
2015-02-12 16:09:17,460 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0007
2015-02-12 16:09:17,460 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0007 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:09:17,460 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0007, with delay of 10800 seconds
2015-02-12 16:09:17,791 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:17,791 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:17,910 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60521 to delete [blk_1073741889_1065, blk_1073741893_1069, blk_1073741883_1059, blk_1073741885_1061, blk_1073741887_1063]
2015-02-12 16:09:17,910 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60511 to delete [blk_1073741891_1067, blk_1073741895_1071, blk_1073741883_1059, blk_1073741885_1061, blk_1073741887_1063]
2015-02-12 16:09:17,919 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:17,920 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:17,920 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:18,049 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:18,052 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(343)) - Container container_1423785972183_0006_01_000001 succeeded 
2015-02-12 16:09:18,053 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-02-12 16:09:18,053 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0006_01_000001
2015-02-12 16:09:18,075 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000001
2015-02-12 16:09:18,075 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000001
2015-02-12 16:09:18,076 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000001
2015-02-12 16:09:18,076 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0006/container_1423785972183_0006_01_000001
2015-02-12 16:09:18,076 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000001
2015-02-12 16:09:18,076 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0006_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-02-12 16:09:18,077 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0006_01_000001 from application application_1423785972183_0006
2015-02-12 16:09:18,077 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:18,077 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0006
2015-02-12 16:09:18,447 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:18,447 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0006_01_000001 in state: COMPLETED event:FINISHED
2015-02-12 16:09:18,447 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000001
2015-02-12 16:09:18,448 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0006_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.67:60556, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 16:09:18,448 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0006_000001 released container container_1423785972183_0006_01_000001 on node: host: 10.1.1.67:60556 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 16:09:18,448 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:18,447 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(660)) - Unregistering app attempt : appattempt_1423785972183_0006_000001
2015-02-12 16:09:18,448 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:18,448 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1423785972183_0006_000001
2015-02-12 16:09:18,448 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0006_000001 State change from FINISHING to FINISHED
2015-02-12 16:09:18,448 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0006 State change from FINISHING to FINISHED
2015-02-12 16:09:18,449 INFO  fair.FairScheduler (FairScheduler.java:removeApplicationAttempt(736)) - Application appattempt_1423785972183_0006_000001 is done. finalState=FINISHED
2015-02-12 16:09:18,449 INFO  amlauncher.AMLauncher (AMLauncher.java:run(267)) - Cleaning master appattempt_1423785972183_0006_000001
2015-02-12 16:09:18,449 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(143)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1423785972183_0006
2015-02-12 16:09:18,449 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0006_01_000008 Container Transitioned from ALLOCATED to KILLED
2015-02-12 16:09:18,449 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0006_01_000008 in state: KILLED event:KILL
2015-02-12 16:09:18,449 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000008
2015-02-12 16:09:18,449 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0006_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 16:09:18,449 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0006_000001 released container container_1423785972183_0006_01_000008 on node: host: 10.1.1.67:60556 #containers=0 available=4096 used=0 with event: KILL
2015-02-12 16:09:18,450 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(115)) - Application application_1423785972183_0006 requests cleared
2015-02-12 16:09:18,449 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(177)) - appId=application_1423785972183_0006,name=[EFFD47884A2A4392A7D7EEC2E1B7338A/F3565F0074E74972B0D0AE51455D4AFF] lower*upper/(1/3),user=soberoi,queue=root.soberoi,state=FINISHED,trackingUrl=http://Edinburgh.local:60554/proxy/application_1423785972183_0006/jobhistory/job/job_1423785972183_0006,appMasterHost=10.1.1.67,startTime=1423786118804,finishTime=1423786151972,finalStatus=KILLED
2015-02-12 16:09:18,452 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0006_000001 (auth:SIMPLE)
2015-02-12 16:09:18,454 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0006_01_000001
2015-02-12 16:09:18,454 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0006	CONTAINERID=container_1423785972183_0006_01_000001
2015-02-12 16:09:18,455 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0006_01_000001, container_1423785972183_0006_01_000002]
2015-02-12 16:09:18,455 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:18,455 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:18,455 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:18,455 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:09:18,456 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0006
2015-02-12 16:09:18,456 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0006
2015-02-12 16:09:18,456 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0006
2015-02-12 16:09:18,456 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0006
2015-02-12 16:09:18,456 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:09:18,456 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0006, with delay of 10800 seconds
2015-02-12 16:09:18,457 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0006
2015-02-12 16:09:18,459 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0006_01_000005]
2015-02-12 16:09:18,460 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:18,460 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:18,460 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:18,460 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:09:18,460 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0006
2015-02-12 16:09:18,461 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0006
2015-02-12 16:09:18,461 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0006
2015-02-12 16:09:18,461 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0006
2015-02-12 16:09:18,461 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0006
2015-02-12 16:09:18,461 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:09:18,461 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0006, with delay of 10800 seconds
2015-02-12 16:09:18,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:09:18,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 16:09:18,672 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 16:09:18,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 16:09:18,690 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null	proto=rpc
2015-02-12 16:09:18,717 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741900_1076
2015-02-12 16:09:18,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/COMMIT_STARTED	dst=null	perm=null	proto=rpc
2015-02-12 16:09:18,759 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/COMMIT_SUCCESS	dst=null	perm=null	proto=rpc
2015-02-12 16:09:18,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/COMMIT_FAIL	dst=null	perm=null	proto=rpc
2015-02-12 16:09:18,766 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741891 for deletion
2015-02-12 16:09:18,766 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741895_1071 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741895 for deletion
2015-02-12 16:09:18,767 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741883 for deletion
2015-02-12 16:09:18,767 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741885 for deletion
2015-02-12 16:09:18,767 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741895_1071 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741895
2015-02-12 16:09:18,767 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741891
2015-02-12 16:09:18,767 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741887 for deletion
2015-02-12 16:09:18,768 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data1/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741883
2015-02-12 16:09:18,768 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741885
2015-02-12 16:09:18,770 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data2/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741887
2015-02-12 16:09:18,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008	dst=null	perm=null	proto=rpc
2015-02-12 16:09:18,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 16:09:18,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:09:18,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009	dst=null	perm=null	proto=rpc
2015-02-12 16:09:18,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null	proto=rpc
2015-02-12 16:09:18,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null	proto=rpc
2015-02-12 16:09:18,906 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741898_1074
2015-02-12 16:09:18,907 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741902_1078
2015-02-12 16:09:18,908 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741899_1075
2015-02-12 16:09:18,909 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741900_1076
2015-02-12 16:09:18,909 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741901_1077
2015-02-12 16:09:18,924 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:18,924 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-02-12 16:09:18,925 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0006
2015-02-12 16:09:18,926 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0006
2015-02-12 16:09:18,926 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_STOP for appId application_1423785972183_0006
2015-02-12 16:09:18,926 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-02-12 16:09:18,927 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(134)) - Scheduling Log Deletion for application: application_1423785972183_0006, with delay of 10800 seconds
2015-02-12 16:09:18,927 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0006
2015-02-12 16:09:18,927 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0006
2015-02-12 16:09:19,053 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:19,127 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741902_1078
2015-02-12 16:09:19,129 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741901_1077
2015-02-12 16:09:19,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:09:19,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:09:19,331 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741899_1075
2015-02-12 16:09:19,332 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741898_1074
2015-02-12 16:09:19,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:09:19,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.splitmetainfo	dst=null	perm=null	proto=rpc
2015-02-12 16:09:19,466 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:19,466 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:19,467 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741889 for deletion
2015-02-12 16:09:19,467 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741893 for deletion
2015-02-12 16:09:19,467 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741883 for deletion
2015-02-12 16:09:19,467 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741885 for deletion
2015-02-12 16:09:19,467 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741887 for deletion
2015-02-12 16:09:19,467 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741889
2015-02-12 16:09:19,468 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741893
2015-02-12 16:09:19,468 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741883
2015-02-12 16:09:19,468 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741885
2015-02-12 16:09:19,469 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741887
2015-02-12 16:09:19,621 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741908_1084
2015-02-12 16:09:19,824 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741904_1080
2015-02-12 16:09:19,825 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741907_1083
2015-02-12 16:09:19,825 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741906_1082
2015-02-12 16:09:19,826 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741898_1074
2015-02-12 16:09:19,827 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741910_1086
2015-02-12 16:09:19,827 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741900_1076
2015-02-12 16:09:19,827 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741905_1081
2015-02-12 16:09:19,929 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:20,057 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:20,225 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741903_1079
2015-02-12 16:09:20,226 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741899_1075
2015-02-12 16:09:20,425 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741902_1078
2015-02-12 16:09:20,426 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741901_1077
2015-02-12 16:09:20,953 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0008_000001 (auth:SIMPLE)
2015-02-12 16:09:20,963 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423785972183_0008_000001
2015-02-12 16:09:20,963 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi	IP=10.1.1.67	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423785972183_0008	APPATTEMPTID=appattempt_1423785972183_0008_000001
2015-02-12 16:09:20,964 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0008_000001 State change from LAUNCHED to RUNNING
2015-02-12 16:09:20,964 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0008 State change from ACCEPTED to RUNNING
2015-02-12 16:09:21,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job_1423785972183_0008_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:09:21,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/4876358366_upper_C3CE3554252F4FBBABE677233BD1E8A2/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 16:09:21,131 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0009_000001 (auth:SIMPLE)
2015-02-12 16:09:21,160 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:21,161 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(272)) - AM registration appattempt_1423785972183_0009_000001
2015-02-12 16:09:21,161 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(122)) - USER=soberoi	IP=10.1.1.67	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1423785972183_0009	APPATTEMPTID=appattempt_1423785972183_0009_000001
2015-02-12 16:09:21,161 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0009_000001 State change from LAUNCHED to RUNNING
2015-02-12 16:09:21,161 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0009 State change from ACCEPTED to RUNNING
2015-02-12 16:09:21,214 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job_1423785972183_0008_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:09:21,276 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job_1423785972183_0009_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:09:21,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/6106191911_lower_551D4F93DDA94A689A0CB5809239257F/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx	proto=rpc
2015-02-12 16:09:21,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job_1423785972183_0009_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:09:21,644 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job_1423785972183_0008_1_conf.xml. BP-2102022600-10.1.1.67-1423785955551 blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:09:21,702 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741911_1087 src: /127.0.0.1:61475 dest: /127.0.0.1:60521
2015-02-12 16:09:21,703 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741911_1087 src: /127.0.0.1:61476 dest: /127.0.0.1:60518
2015-02-12 16:09:21,705 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741911_1087 src: /127.0.0.1:61477 dest: /127.0.0.1:60511
2015-02-12 16:09:21,771 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61477, dest: /127.0.0.1:60511, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1999320594_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741911_1087, duration: 64144000
2015-02-12 16:09:21,771 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741911_1087, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:21,771 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 0
2015-02-12 16:09:21,772 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61476, dest: /127.0.0.1:60518, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1999320594_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741911_1087, duration: 65260000
2015-02-12 16:09:21,773 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741911_1087, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:21,773 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 0
2015-02-12 16:09:21,773 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61475, dest: /127.0.0.1:60521, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1999320594_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741911_1087, duration: 66701000
2015-02-12 16:09:21,774 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741911_1087, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:21,774 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:21,782 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job_1423785972183_0008_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1999320594_1
2015-02-12 16:09:21,853 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job_1423785972183_0008.summary	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:09:21,858 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job_1423785972183_0008.summary. BP-2102022600-10.1.1.67-1423785955551 blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:09:21,860 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741912_1088 src: /127.0.0.1:61478 dest: /127.0.0.1:60518
2015-02-12 16:09:21,862 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741912_1088 src: /127.0.0.1:61479 dest: /127.0.0.1:60515
2015-02-12 16:09:21,863 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741912_1088 src: /127.0.0.1:61480 dest: /127.0.0.1:60511
2015-02-12 16:09:21,866 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61480, dest: /127.0.0.1:60511, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1999320594_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741912_1088, duration: 1358000
2015-02-12 16:09:21,867 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741912_1088, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:21,867 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:21,867 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61479, dest: /127.0.0.1:60515, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1999320594_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741912_1088, duration: 2077000
2015-02-12 16:09:21,867 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741912_1088, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:21,868 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:21,868 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61478, dest: /127.0.0.1:60518, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1999320594_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741912_1088, duration: 3048000
2015-02-12 16:09:21,868 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741912_1088, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:21,869 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:21,871 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job_1423785972183_0008.summary is closed by DFSClient_NONMAPREDUCE_1999320594_1
2015-02-12 16:09:21,942 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job_1423785972183_0009_1_conf.xml. BP-2102022600-10.1.1.67-1423785955551 blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]}
2015-02-12 16:09:22,000 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741913_1089 src: /127.0.0.1:61481 dest: /127.0.0.1:60518
2015-02-12 16:09:22,002 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741913_1089 src: /127.0.0.1:61482 dest: /127.0.0.1:60511
2015-02-12 16:09:22,004 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741913_1089 src: /127.0.0.1:61483 dest: /127.0.0.1:60515
2015-02-12 16:09:22,088 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61483, dest: /127.0.0.1:60515, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1523467809_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741913_1089, duration: 82241000
2015-02-12 16:09:22,088 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741913_1089, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:22,088 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]} size 0
2015-02-12 16:09:22,090 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61482, dest: /127.0.0.1:60511, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1523467809_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741913_1089, duration: 83337000
2015-02-12 16:09:22,090 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741913_1089, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:22,090 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:22,091 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61481, dest: /127.0.0.1:60518, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1523467809_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741913_1089, duration: 85196000
2015-02-12 16:09:22,091 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741913_1089, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:22,091 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:22,095 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job_1423785972183_0009_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1523467809_1
2015-02-12 16:09:22,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job_1423785972183_0009.summary	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:09:22,149 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job_1423785972183_0009.summary. BP-2102022600-10.1.1.67-1423785955551 blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:09:22,152 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741914_1090 src: /127.0.0.1:61484 dest: /127.0.0.1:60518
2015-02-12 16:09:22,155 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741914_1090 src: /127.0.0.1:61485 dest: /127.0.0.1:60521
2015-02-12 16:09:22,156 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741914_1090 src: /127.0.0.1:61486 dest: /127.0.0.1:60511
2015-02-12 16:09:22,161 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61486, dest: /127.0.0.1:60511, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1523467809_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741914_1090, duration: 2792000
2015-02-12 16:09:22,162 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741914_1090, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:22,163 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:22,164 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61485, dest: /127.0.0.1:60521, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1523467809_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741914_1090, duration: 4453000
2015-02-12 16:09:22,164 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741914_1090, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:22,166 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61484, dest: /127.0.0.1:60518, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1523467809_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741914_1090, duration: 7396000
2015-02-12 16:09:22,166 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:22,166 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741914_1090, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:22,167 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:22,168 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:22,170 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job_1423785972183_0009.summary is closed by DFSClient_NONMAPREDUCE_-1523467809_1
2015-02-12 16:09:22,481 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:09:22,481 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000003
2015-02-12 16:09:22,481 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0008_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 16:09:22,482 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000002 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:09:22,482 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000002
2015-02-12 16:09:22,482 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0009_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 16:09:22,817 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:09:22,817 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000004
2015-02-12 16:09:22,817 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0008_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 16:09:22,943 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000003 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:09:22,943 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000003
2015-02-12 16:09:22,943 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0009_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available after allocation
2015-02-12 16:09:23,117 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60560 for container : container_1423785972183_0008_01_000003
2015-02-12 16:09:23,118 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:09:23,118 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60568 for container : container_1423785972183_0008_01_000004
2015-02-12 16:09:23,119 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:09:23,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,178 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,200 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,213 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:23,260 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0008_000001 (auth:SIMPLE)
2015-02-12 16:09:23,260 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0008_000001 (auth:SIMPLE)
2015-02-12 16:09:23,263 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0008_01_000003 by user soberoi
2015-02-12 16:09:23,264 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000003
2015-02-12 16:09:23,264 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0008_01_000003 to application application_1423785972183_0008
2015-02-12 16:09:23,264 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 16:09:23,265 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0008
2015-02-12 16:09:23,265 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0008
2015-02-12 16:09:23,265 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:09:23,265 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0008
2015-02-12 16:09:23,266 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:09:23,268 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0008_01_000004 by user soberoi
2015-02-12 16:09:23,269 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0008
2015-02-12 16:09:23,269 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000004
2015-02-12 16:09:23,269 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0008 transitioned from NEW to INITING
2015-02-12 16:09:23,269 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0008_01_000004 to application application_1423785972183_0008
2015-02-12 16:09:23,269 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0008 transitioned from INITING to RUNNING
2015-02-12 16:09:23,270 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 16:09:23,270 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0008
2015-02-12 16:09:23,270 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0008
2015-02-12 16:09:23,270 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:09:23,270 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0008
2015-02-12 16:09:23,270 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:09:23,270 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:09:23,271 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0008_01_000004
2015-02-12 16:09:23,287 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423785972183_0008_01_000004.tokens. Credentials list: 
2015-02-12 16:09:23,296 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60556 for container : container_1423785972183_0009_01_000002
2015-02-12 16:09:23,297 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:09:23,297 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60564 for container : container_1423785972183_0009_01_000003
2015-02-12 16:09:23,297 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:09:23,333 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 16:09:23,333 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:23,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,483 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:09:23,483 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000005
2015-02-12 16:09:23,483 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0008_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 16:09:23,483 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:09:23,484 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000004 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:09:23,484 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000004
2015-02-12 16:09:23,484 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0009_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 16:09:23,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,499 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:09:23,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-3483439372465658835.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,544 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000003/default_container_executor.sh]
2015-02-12 16:09:23,642 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0009_000001 (auth:SIMPLE)
2015-02-12 16:09:23,661 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0009_01_000003 by user soberoi
2015-02-12 16:09:23,661 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0009
2015-02-12 16:09:23,661 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000003
2015-02-12 16:09:23,661 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0009 transitioned from NEW to INITING
2015-02-12 16:09:23,661 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0009_01_000003 to application application_1423785972183_0009
2015-02-12 16:09:23,661 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0009 transitioned from INITING to RUNNING
2015-02-12 16:09:23,662 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000003 transitioned from NEW to LOCALIZING
2015-02-12 16:09:23,662 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0009
2015-02-12 16:09:23,662 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0009
2015-02-12 16:09:23,662 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:09:23,662 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0009
2015-02-12 16:09:23,662 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:09:23,662 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:09:23,663 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0009_01_000003
2015-02-12 16:09:23,668 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0009_000001 (auth:SIMPLE)
2015-02-12 16:09:23,685 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423785972183_0009_01_000003.tokens. Credentials list: 
2015-02-12 16:09:23,688 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0009_01_000002 by user soberoi
2015-02-12 16:09:23,689 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0009
2015-02-12 16:09:23,689 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000002
2015-02-12 16:09:23,689 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0009 transitioned from NEW to INITING
2015-02-12 16:09:23,689 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0009_01_000002 to application application_1423785972183_0009
2015-02-12 16:09:23,689 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0009 transitioned from INITING to RUNNING
2015-02-12 16:09:23,690 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000002 transitioned from NEW to LOCALIZING
2015-02-12 16:09:23,690 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0009
2015-02-12 16:09:23,690 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0009
2015-02-12 16:09:23,690 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:09:23,690 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0009
2015-02-12 16:09:23,690 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:09:23,690 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:09:23,691 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0009_01_000002
2015-02-12 16:09:23,697 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1423785972183_0008_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000004.tokens
2015-02-12 16:09:23,698 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0008
2015-02-12 16:09:23,709 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423785972183_0009_01_000002.tokens. Credentials list: 
2015-02-12 16:09:23,721 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741905_1081
2015-02-12 16:09:23,723 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741903_1079
2015-02-12 16:09:23,724 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741908_1084
2015-02-12 16:09:23,822 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:09:23,823 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000006 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:09:23,824 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000006
2015-02-12 16:09:23,824 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0008_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available after allocation
2015-02-12 16:09:23,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,883 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:09:23,910 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:09:23,919 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741907_1083
2015-02-12 16:09:23,920 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741906_1082
2015-02-12 16:09:23,921 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741908_1084
2015-02-12 16:09:23,921 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741905_1081
2015-02-12 16:09:23,922 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741909_1085
2015-02-12 16:09:23,949 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:09:23,949 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000005 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:09:23,950 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000005
2015-02-12 16:09:23,950 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0009_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available after allocation
2015-02-12 16:09:23,953 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0008/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:09:23,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:23,990 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:24,049 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0008/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:09:24,049 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:09:24,072 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1423785972183_0009_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000003.tokens
2015-02-12 16:09:24,073 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0009
2015-02-12 16:09:24,115 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 16:09:24,115 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:24,116 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1423785972183_0009_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000002.tokens
2015-02-12 16:09:24,117 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0009
2015-02-12 16:09:24,128 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741904_1080
2015-02-12 16:09:24,129 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741906_1082
2015-02-12 16:09:24,130 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741903_1079
2015-02-12 16:09:24,130 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60556 for container : container_1423785972183_0008_01_000005
2015-02-12 16:09:24,131 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:09:24,132 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741909_1085
2015-02-12 16:09:24,132 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:09:24,147 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0008_000001 (auth:SIMPLE)
2015-02-12 16:09:24,147 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0008_000001 (auth:SIMPLE)
2015-02-12 16:09:24,149 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0008_01_000005 by user soberoi
2015-02-12 16:09:24,149 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0008_01_000006 by user soberoi
2015-02-12 16:09:24,150 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0008
2015-02-12 16:09:24,150 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000006
2015-02-12 16:09:24,150 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0008_01_000006 to application application_1423785972183_0008
2015-02-12 16:09:24,150 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0008 transitioned from NEW to INITING
2015-02-12 16:09:24,150 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0008_01_000005 to application application_1423785972183_0008
2015-02-12 16:09:24,150 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000005
2015-02-12 16:09:24,150 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0008 transitioned from INITING to RUNNING
2015-02-12 16:09:24,150 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000006 transitioned from NEW to LOCALIZING
2015-02-12 16:09:24,151 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0008
2015-02-12 16:09:24,151 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 16:09:24,151 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0008
2015-02-12 16:09:24,151 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0008
2015-02-12 16:09:24,151 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:09:24,151 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0008
2015-02-12 16:09:24,151 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0008
2015-02-12 16:09:24,151 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:09:24,151 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:09:24,152 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0008
2015-02-12 16:09:24,152 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:09:24,152 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0008_01_000005
2015-02-12 16:09:24,152 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:09:24,191 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423785972183_0008_01_000005.tokens. Credentials list: 
2015-02-12 16:09:24,212 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000006 transitioned from LOCALIZED to RUNNING
2015-02-12 16:09:24,213 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:24,214 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:24,321 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:createAndGetNMToken(200)) - Sending NMToken for nodeId : 10.1.1.67:60560 for container : container_1423785972183_0009_01_000004
2015-02-12 16:09:24,322 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:09:24,322 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:09:24,325 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741910_1086
2015-02-12 16:09:24,325 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741910_1086
2015-02-12 16:09:24,337 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741906_1082
2015-02-12 16:09:24,338 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741909_1085
2015-02-12 16:09:24,339 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741907_1083
2015-02-12 16:09:24,339 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0009_000001 (auth:SIMPLE)
2015-02-12 16:09:24,339 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0009_000001 (auth:SIMPLE)
2015-02-12 16:09:24,354 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0009_01_000005 by user soberoi
2015-02-12 16:09:24,354 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000005
2015-02-12 16:09:24,354 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0009_01_000005 to application application_1423785972183_0009
2015-02-12 16:09:24,355 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000005 transitioned from NEW to LOCALIZING
2015-02-12 16:09:24,355 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0009
2015-02-12 16:09:24,355 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0009
2015-02-12 16:09:24,355 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:09:24,355 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0009
2015-02-12 16:09:24,355 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0009_01_000005
2015-02-12 16:09:24,361 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0009_01_000004 by user soberoi
2015-02-12 16:09:24,361 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(826)) - Creating a new application reference for app application_1423785972183_0009
2015-02-12 16:09:24,361 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000004
2015-02-12 16:09:24,362 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0009 transitioned from NEW to INITING
2015-02-12 16:09:24,362 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0009_01_000004 to application application_1423785972183_0009
2015-02-12 16:09:24,362 INFO  application.Application (ApplicationImpl.java:handle(458)) - Application application_1423785972183_0009 transitioned from INITING to RUNNING
2015-02-12 16:09:24,362 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000004 transitioned from NEW to LOCALIZING
2015-02-12 16:09:24,362 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0009
2015-02-12 16:09:24,363 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0009
2015-02-12 16:09:24,363 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:09:24,363 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0009
2015-02-12 16:09:24,363 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar transitioned from INIT to DOWNLOADING
2015-02-12 16:09:24,363 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml transitioned from INIT to DOWNLOADING
2015-02-12 16:09:24,363 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0009_01_000004
2015-02-12 16:09:24,379 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423785972183_0009_01_000005.tokens. Credentials list: 
2015-02-12 16:09:24,388 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423785972183_0009_01_000004.tokens. Credentials list: 
2015-02-12 16:09:24,427 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000004/default_container_executor.sh]
2015-02-12 16:09:24,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:24,436 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:24,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:24,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:24,489 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:09:24,490 INFO  fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423785972183_0008
2015-02-12 16:09:24,490 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000007 Container Transitioned from NEW to RESERVED
2015-02-12 16:09:24,490 INFO  fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423785972183_0008_01_000007 on node host: 10.1.1.67:60560 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@53ee7656
2015-02-12 16:09:24,490 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:09:24,490 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:09:24,491 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000008 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:09:24,491 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000008
2015-02-12 16:09:24,491 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0008_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 16:09:24,519 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0009/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:09:24,525 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741904_1080
2015-02-12 16:09:24,535 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000006/default_container_executor.sh]
2015-02-12 16:09:24,540 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0009/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:09:24,542 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741904_1080
2015-02-12 16:09:24,542 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741905_1081
2015-02-12 16:09:24,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:24,614 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:24,636 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:24,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:24,680 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:09:24,682 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0009/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:09:24,682 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:09:24,702 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0009/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:09:24,702 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:09:24,703 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:09:24,742 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000002 transitioned from LOCALIZED to RUNNING
2015-02-12 16:09:24,742 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:24,746 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741903_1079
2015-02-12 16:09:24,760 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 16:09:24,760 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:24,761 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000003 transitioned from LOCALIZED to RUNNING
2015-02-12 16:09:24,761 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:24,824 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:09:24,825 INFO  fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423785972183_0009
2015-02-12 16:09:24,825 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000006 Container Transitioned from NEW to RESERVED
2015-02-12 16:09:24,825 INFO  fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423785972183_0009_01_000006 on node host: 10.1.1.67:60568 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@334e0329
2015-02-12 16:09:24,923 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1423785972183_0009_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000004.tokens
2015-02-12 16:09:24,923 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0009
2015-02-12 16:09:24,954 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:09:24,955 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000007 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:09:24,955 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000007
2015-02-12 16:09:24,955 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0009_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available after allocation
2015-02-12 16:09:24,996 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000005/default_container_executor.sh]
2015-02-12 16:09:24,996 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000003/default_container_executor.sh]
2015-02-12 16:09:25,007 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000002/default_container_executor.sh]
2015-02-12 16:09:25,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:25,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:25,137 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:09:25,146 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0008_000001 (auth:SIMPLE)
2015-02-12 16:09:25,148 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0008_01_000008 by user soberoi
2015-02-12 16:09:25,148 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000008
2015-02-12 16:09:25,148 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0008_01_000008 to application application_1423785972183_0008
2015-02-12 16:09:25,149 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000008 transitioned from NEW to LOCALIZING
2015-02-12 16:09:25,149 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0008
2015-02-12 16:09:25,149 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0008
2015-02-12 16:09:25,149 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:09:25,149 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0008
2015-02-12 16:09:25,150 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(694)) - Created localizer for container_1423785972183_0008_01_000008
2015-02-12 16:09:25,170 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1153)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423785972183_0008_01_000008.tokens. Credentials list: 
2015-02-12 16:09:25,196 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0009/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:09:25,216 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:25,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:25,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:25,314 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0009/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:09:25,314 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:09:25,331 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:09:25,341 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0009_000001 (auth:SIMPLE)
2015-02-12 16:09:25,343 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(786)) - Start request for container_1423785972183_0009_01_000007 by user soberoi
2015-02-12 16:09:25,344 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000007
2015-02-12 16:09:25,344 INFO  application.Application (ApplicationImpl.java:transition(298)) - Adding container_1423785972183_0009_01_000007 to application application_1423785972183_0009
2015-02-12 16:09:25,344 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000007 transitioned from NEW to LOCALIZING
2015-02-12 16:09:25,344 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1423785972183_0009
2015-02-12 16:09:25,344 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event APPLICATION_INIT for appId application_1423785972183_0009
2015-02-12 16:09:25,345 INFO  containermanager.AuxServices (AuxServices.java:handle(200)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-02-12 16:09:25,345 INFO  mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(560)) - Added token for job_1423785972183_0009
2015-02-12 16:09:25,345 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:09:25,431 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000007 transitioned from LOCALIZED to RUNNING
2015-02-12 16:09:25,431 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:25,442 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000004 transitioned from LOCALIZED to RUNNING
2015-02-12 16:09:25,442 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:25,492 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:09:25,493 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000009 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:09:25,493 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000009
2015-02-12 16:09:25,493 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0008_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 16:09:25,493 INFO  fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423785972183_0008_000001 on node host: 10.1.1.67:60560 #containers=3 available=0 used=4096
2015-02-12 16:09:25,493 INFO  fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423785972183_0008 unreserved  on node host: 10.1.1.67:60560 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 16:09:25,494 INFO  fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423785972183_0009
2015-02-12 16:09:25,494 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000008 Container Transitioned from NEW to RESERVED
2015-02-12 16:09:25,494 INFO  fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423785972183_0009_01_000008 on node host: 10.1.1.67:60560 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@334e0329
2015-02-12 16:09:25,661 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000007/default_container_executor.sh]
2015-02-12 16:09:25,679 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000004/default_container_executor.sh]
2015-02-12 16:09:25,724 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:09:25,746 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:09:25,828 INFO  fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423785972183_0009_000001 on node host: 10.1.1.67:60568 #containers=3 available=0 used=4096
2015-02-12 16:09:25,828 INFO  fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423785972183_0009 unreserved  on node host: 10.1.1.67:60568 #containers=3 available=0 used=4096, currently has 1 at priority 20; currentReservation <memory:1024, vCores:1>
2015-02-12 16:09:25,828 INFO  fair.FSAppAttempt (FSAppAttempt.java:reserve(441)) - Making reservation: node=10.1.1.67 app_id=application_1423785972183_0009
2015-02-12 16:09:25,828 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000009 Container Transitioned from NEW to RESERVED
2015-02-12 16:09:25,829 INFO  fair.FSSchedulerNode (FSSchedulerNode.java:reserveResource(75)) - Reserved container container_1423785972183_0009_01_000009 on node host: 10.1.1.67:60568 #containers=3 available=0 used=4096 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@334e0329
2015-02-12 16:09:25,884 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1423785972183_0008_01_000008.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000008.tokens
2015-02-12 16:09:25,884 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0008
2015-02-12 16:09:25,928 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1423785972183_0009_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000005.tokens
2015-02-12 16:09:25,931 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0009
2015-02-12 16:09:25,955 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-02-12 16:09:25,955 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000010 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:09:25,956 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000010
2015-02-12 16:09:25,956 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0009_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available after allocation
2015-02-12 16:09:26,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:26,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar	dst=null	perm=null	proto=rpc
2015-02-12 16:09:26,148 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 16:09:26,149 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:09:26,208 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.jar(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0008/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:09:26,222 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:26,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:26,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:26,325 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://localhost:60510/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.xml(->/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0008/filecache/11/job.xml) transitioned from DOWNLOADING to LOCALIZED
2015-02-12 16:09:26,325 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:09:26,326 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-02-12 16:09:26,336 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(179)) - checking for deactivate... 
2015-02-12 16:09:26,336 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000010 Container Transitioned from ALLOCATED to ACQUIRED
2015-02-12 16:09:26,374 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000005 transitioned from LOCALIZED to RUNNING
2015-02-12 16:09:26,374 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000008 transitioned from LOCALIZED to RUNNING
2015-02-12 16:09:26,375 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:26,375 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:26,493 INFO  fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423785972183_0009_000001 on node host: 10.1.1.67:60560 #containers=3 available=0 used=4096
2015-02-12 16:09:26,493 INFO  fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423785972183_0009 unreserved  on node host: 10.1.1.67:60560 #containers=3 available=0 used=4096, currently has 1 at priority 20; currentReservation <memory:1024, vCores:1>
2015-02-12 16:09:26,591 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000005/default_container_executor.sh]
2015-02-12 16:09:26,591 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(191)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000008/default_container_executor.sh]
2015-02-12 16:09:26,702 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(178)) - Rescanning after 30005 milliseconds
2015-02-12 16:09:26,702 INFO  blockmanagement.CacheReplicationMonitor (CacheReplicationMonitor.java:run(203)) - Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).
2015-02-12 16:09:26,831 INFO  fair.FairScheduler (FairScheduler.java:attemptScheduling(1051)) - Releasing reservation that cannot be satisfied for application appattempt_1423785972183_0009_000001 on node host: 10.1.1.67:60568 #containers=3 available=0 used=4096
2015-02-12 16:09:26,831 INFO  fair.FSAppAttempt (FSAppAttempt.java:unreserveInternal(169)) - Application application_1423785972183_0009 unreserved  on node host: 10.1.1.67:60568 #containers=3 available=0 used=4096, currently has 0 at priority 20; currentReservation <memory:0, vCores:0>
2015-02-12 16:09:27,156 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000009 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:09:27,156 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0008_01_000009 in state: RELEASED event:RELEASED
2015-02-12 16:09:27,156 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000009
2015-02-12 16:09:27,156 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0008_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 16:09:27,157 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0008_000001 released container container_1423785972183_0008_01_000009 on node: host: 10.1.1.67:60556 #containers=3 available=1024 used=3072 with event: RELEASED
2015-02-12 16:09:27,224 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:27,345 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000010 Container Transitioned from ACQUIRED to RELEASED
2015-02-12 16:09:27,345 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0009_01_000010 in state: RELEASED event:RELEASED
2015-02-12 16:09:27,345 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	IP=10.1.1.67	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000010
2015-02-12 16:09:27,345 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0009_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-02-12 16:09:27,345 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0009_000001 released container container_1423785972183_0009_01_000010 on node: host: 10.1.1.67:60564 #containers=3 available=1024 used=3072 with event: RELEASED
2015-02-12 16:09:27,361 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(575)) - Initializing user soberoi
2015-02-12 16:09:27,499 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0008_01_000009
2015-02-12 16:09:27,510 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1423785972183_0008_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000005.tokens
2015-02-12 16:09:27,511 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(107)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0008
2015-02-12 16:09:27,967 WARN  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(1045)) - Event EventType: KILL_CONTAINER sent to absent container container_1423785972183_0009_01_000010
2015-02-12 16:09:28,232 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:29,240 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:29,334 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741912_1088
2015-02-12 16:09:29,336 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741913_1089
2015-02-12 16:09:29,531 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741914_1090
2015-02-12 16:09:29,533 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741913_1089
2015-02-12 16:09:29,534 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741911_1087
2015-02-12 16:09:29,534 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741912_1088
2015-02-12 16:09:29,755 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741913_1089
2015-02-12 16:09:29,756 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741914_1090
2015-02-12 16:09:29,757 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741911_1087
2015-02-12 16:09:29,757 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741912_1088
2015-02-12 16:09:30,247 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:30,437 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741911_1087
2015-02-12 16:09:30,437 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(444)) - Verification succeeded for BP-2102022600-10.1.1.67-1423785955551:blk_1073741914_1090
2015-02-12 16:09:31,252 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:32,254 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:33,258 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:34,264 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:35,273 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:36,278 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:37,284 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:38,292 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:39,300 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:40,305 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:41,307 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:42,315 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:42,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:43,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:43,321 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:43,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:43,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:43,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:43,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:43,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:43,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:44,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:44,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:44,321 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(400)) - testing if running
2015-02-12 16:09:44,469 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:44,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:44,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job.split	dst=null	perm=null	proto=rpc
2015-02-12 16:09:44,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:44,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:44,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:44,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:44,760 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:45,196 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4876358366_upper_C3CE3554252F4FBBABE677233BD1E8A2/_temporary/1/_temporary/attempt_1423785972183_0008_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:45,266 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0008_000001 (auth:SIMPLE)
2015-02-12 16:09:45,269 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0008_01_000003
2015-02-12 16:09:45,270 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000003
2015-02-12 16:09:45,270 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000003 transitioned from RUNNING to KILLING
2015-02-12 16:09:45,270 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0008_01_000003
2015-02-12 16:09:45,292 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0008_01_000003 is : 143
2015-02-12 16:09:45,293 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job_1423785972183_0008_1.jhist. BP-2102022600-10.1.1.67-1423785955551 blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:09:45,295 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741915_1091 src: /127.0.0.1:61565 dest: /127.0.0.1:60515
2015-02-12 16:09:45,297 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741915_1091 src: /127.0.0.1:61566 dest: /127.0.0.1:60521
2015-02-12 16:09:45,299 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741915_1091 src: /127.0.0.1:61567 dest: /127.0.0.1:60511
2015-02-12 16:09:45,303 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:45,304 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000003
2015-02-12 16:09:45,305 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000003
2015-02-12 16:09:45,305 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:45,305 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0008_01_000003 from application application_1423785972183_0008
2015-02-12 16:09:45,305 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000003
2015-02-12 16:09:45,305 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000003
2015-02-12 16:09:45,305 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000003
2015-02-12 16:09:45,307 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:45,307 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0008
2015-02-12 16:09:45,308 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job_1423785972183_0008_1.jhist for DFSClient_NONMAPREDUCE_1999320594_1
2015-02-12 16:09:45,324 INFO  hadoop.FlowPlatformTest (FlowPlatformTest.java:failingListenerTest(416)) - calling stop
2015-02-12 16:09:45,324 WARN  flow.Flow (BaseFlow.java:logWarn(1388)) - [lower*upper] flow listener cascading.flow.FailingFlowListener@14d5e68b threw throwable
java.lang.RuntimeException: intentionally failed on: STOPPING
	at cascading.flow.FailingFlowListener.onStopping(FailingFlowListener.java:53)
	at cascading.flow.BaseFlow$SafeFlowListener.onStopping(BaseFlow.java:1544)
	at cascading.flow.BaseFlow.fireOnStopping(BaseFlow.java:1346)
	at cascading.flow.BaseFlow.stop(BaseFlow.java:854)
	at cascading.flow.hadoop.FlowPlatformTest.failingListenerTest(FlowPlatformTest.java:418)
	at cascading.flow.hadoop.FlowPlatformTest.testFailingListenerStopping(FlowPlatformTest.java:328)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
	at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:86)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:49)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:50)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
	at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:105)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
	at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:64)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
2015-02-12 16:09:45,326 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] stopping all jobs
2015-02-12 16:09:45,326 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (3/3) ...platform/STOPPING/stopped
2015-02-12 16:09:45,328 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (2/3)
2015-02-12 16:09:45,360 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0009_000001 (auth:SIMPLE)
2015-02-12 16:09:45,363 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0009_000001 (auth:SIMPLE)
2015-02-12 16:09:45,366 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0009_000001 (auth:SIMPLE)
2015-02-12 16:09:45,368 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0009_000001 (auth:SIMPLE)
2015-02-12 16:09:45,371 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0009_01_000002
2015-02-12 16:09:45,371 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000002
2015-02-12 16:09:45,371 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000002 transitioned from RUNNING to KILLING
2015-02-12 16:09:45,371 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0009_01_000002
2015-02-12 16:09:45,371 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0009_01_000005
2015-02-12 16:09:45,372 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000005
2015-02-12 16:09:45,372 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000005 transitioned from RUNNING to KILLING
2015-02-12 16:09:45,372 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0009_01_000005
2015-02-12 16:09:45,376 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0009_000001 (auth:SIMPLE)
2015-02-12 16:09:45,382 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0009_01_000004
2015-02-12 16:09:45,382 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000004
2015-02-12 16:09:45,382 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0009_01_000003
2015-02-12 16:09:45,383 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000003
2015-02-12 16:09:45,383 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000004 transitioned from RUNNING to KILLING
2015-02-12 16:09:45,383 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0009_01_000004
2015-02-12 16:09:45,384 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:45,384 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0008_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 16:09:45,384 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000003
2015-02-12 16:09:45,384 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0008_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 16:09:45,384 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0008_000001 released container container_1423785972183_0008_01_000003 on node: host: 10.1.1.67:60560 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 16:09:45,389 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0009_01_000007
2015-02-12 16:09:45,390 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000007
2015-02-12 16:09:45,393 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job_1423785972183_0009_1.jhist. BP-2102022600-10.1.1.67-1423785955551 blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW]]}
2015-02-12 16:09:45,400 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0009_01_000002 is : 143
2015-02-12 16:09:45,401 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0009_01_000005 is : 143
2015-02-12 16:09:45,408 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741916_1092 src: /127.0.0.1:61574 dest: /127.0.0.1:60518
2015-02-12 16:09:45,413 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741916_1092 src: /127.0.0.1:61575 dest: /127.0.0.1:60511
2015-02-12 16:09:45,416 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741916_1092 src: /127.0.0.1:61576 dest: /127.0.0.1:60521
2015-02-12 16:09:45,422 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:45,423 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000002
2015-02-12 16:09:45,423 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000002
2015-02-12 16:09:45,424 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000002
2015-02-12 16:09:45,424 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:45,424 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0009_01_000002 from application application_1423785972183_0009
2015-02-12 16:09:45,424 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000002
2015-02-12 16:09:45,425 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000002
2015-02-12 16:09:45,424 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:45,426 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0009
2015-02-12 16:09:45,427 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000003 transitioned from RUNNING to KILLING
2015-02-12 16:09:45,427 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000007 transitioned from RUNNING to KILLING
2015-02-12 16:09:45,427 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:45,427 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0009_01_000003
2015-02-12 16:09:45,431 INFO  hdfs.StateChange (FSNamesystem.java:fsync(4286)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job_1423785972183_0009_1.jhist for DFSClient_NONMAPREDUCE_-1523467809_1
2015-02-12 16:09:45,443 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0009_01_000004 is : 143
2015-02-12 16:09:45,451 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0009_01_000003 is : 143
2015-02-12 16:09:45,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/6106191911_lower_551D4F93DDA94A689A0CB5809239257F/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 16:09:45,457 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0009_01_000007
2015-02-12 16:09:45,457 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:45,458 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000004
2015-02-12 16:09:45,459 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000004
2015-02-12 16:09:45,459 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000004
2015-02-12 16:09:45,459 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000004
2015-02-12 16:09:45,459 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000004
2015-02-12 16:09:45,460 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:45,460 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0009_01_000004 from application application_1423785972183_0009
2015-02-12 16:09:45,460 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:45,460 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0009
2015-02-12 16:09:45,477 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0009_01_000007 is : 143
2015-02-12 16:09:45,489 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000005
2015-02-12 16:09:45,491 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61576, dest: /127.0.0.1:60521, bytes: 22224, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1523467809_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741916_1092, duration: 71877000
2015-02-12 16:09:45,492 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741916_1092, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:45,552 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED]]} size 13268
2015-02-12 16:09:45,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:45,554 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61575, dest: /127.0.0.1:60511, bytes: 22224, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1523467809_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741916_1092, duration: 134468000
2015-02-12 16:09:45,554 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741916_1092, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:45,555 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 13268
2015-02-12 16:09:45,561 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61574, dest: /127.0.0.1:60518, bytes: 22224, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1523467809_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741916_1092, duration: 140898000
2015-02-12 16:09:45,561 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741916_1092, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:45,561 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 13268
2015-02-12 16:09:45,563 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000005
2015-02-12 16:09:45,566 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job_1423785972183_0009_1.jhist is closed by DFSClient_NONMAPREDUCE_-1523467809_1
2015-02-12 16:09:45,569 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:09:45,570 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000005
2015-02-12 16:09:45,572 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009.summary_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]}
2015-02-12 16:09:45,573 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000005
2015-02-12 16:09:45,574 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:45,574 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741917_1093 src: /127.0.0.1:61577 dest: /127.0.0.1:60521
2015-02-12 16:09:45,574 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:45,574 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000005
2015-02-12 16:09:45,575 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:45,575 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000003
2015-02-12 16:09:45,576 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741917_1093 src: /127.0.0.1:61578 dest: /127.0.0.1:60511
2015-02-12 16:09:45,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/upper.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:45,584 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741917_1093 src: /127.0.0.1:61579 dest: /127.0.0.1:60515
2015-02-12 16:09:45,585 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000003
2015-02-12 16:09:45,587 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000003
2015-02-12 16:09:45,588 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000003
2015-02-12 16:09:45,588 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61579, dest: /127.0.0.1:60515, bytes: 412, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1523467809_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741917_1093, duration: 2352000
2015-02-12 16:09:45,588 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741917_1093, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:45,589 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]} size 0
2015-02-12 16:09:45,589 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61578, dest: /127.0.0.1:60511, bytes: 412, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1523467809_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741917_1093, duration: 2312000
2015-02-12 16:09:45,589 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741917_1093, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:45,589 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:45,590 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61577, dest: /127.0.0.1:60521, bytes: 412, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1523467809_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741917_1093, duration: 3916000
2015-02-12 16:09:45,590 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741917_1093, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:45,590 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:45,591 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000007
2015-02-12 16:09:45,592 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1523467809_1
2015-02-12 16:09:45,594 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000007
2015-02-12 16:09:45,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:45,596 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000007
2015-02-12 16:09:45,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job_1423785972183_0009_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:09:45,602 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1423785972183_0009/container_1423785972183_0009_01_000007
2015-02-12 16:09:45,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009-1423786154320-soberoi-%5B99214C0970F243C192B41E0630470E0E%2F9633472D424B45F4-1423786185448-0-0-KILLED-root.soberoi-1423786161265.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:09:45,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job_1423785972183_0009_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:09:45,607 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0009_01_000005 from application application_1423785972183_0009
2015-02-12 16:09:45,608 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:45,608 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0009
2015-02-12 16:09:45,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009-1423786154320-soberoi-%5B99214C0970F243C192B41E0630470E0E%2F9633472D424B45F4-1423786185448-0-0-KILLED-root.soberoi-1423786161265.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:09:45,608 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000003
2015-02-12 16:09:45,609 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:45,609 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000007
2015-02-12 16:09:45,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job_1423785972183_0009_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:09:45,609 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0009_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:45,610 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0009_01_000003 from application application_1423785972183_0009
2015-02-12 16:09:45,611 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:45,611 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0009
2015-02-12 16:09:45,611 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0009_01_000007 from application application_1423785972183_0009
2015-02-12 16:09:45,611 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:45,611 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0009
2015-02-12 16:09:45,614 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009-1423786154320-soberoi-%5B99214C0970F243C192B41E0630470E0E%2F9633472D424B45F4-1423786185448-0-0-KILLED-root.soberoi-1423786161265.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:09:45,619 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009-1423786154320-soberoi-%5B99214C0970F243C192B41E0630470E0E%2F9633472D424B45F4-1423786185448-0-0-KILLED-root.soberoi-1423786161265.jhist_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW]]}
2015-02-12 16:09:45,621 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741918_1094 src: /127.0.0.1:61582 dest: /127.0.0.1:60521
2015-02-12 16:09:45,622 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741918_1094 src: /127.0.0.1:61583 dest: /127.0.0.1:60518
2015-02-12 16:09:45,624 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741918_1094 src: /127.0.0.1:61584 dest: /127.0.0.1:60515
2015-02-12 16:09:45,627 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61584, dest: /127.0.0.1:60515, bytes: 22224, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1523467809_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741918_1094, duration: 1792000
2015-02-12 16:09:45,629 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741918_1094, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:45,630 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:45,630 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61583, dest: /127.0.0.1:60518, bytes: 22224, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1523467809_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741918_1094, duration: 4587000
2015-02-12 16:09:45,631 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741918_1094, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:45,632 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61582, dest: /127.0.0.1:60521, bytes: 22224, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1523467809_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741918_1094, duration: 5912000
2015-02-12 16:09:45,632 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:45,632 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741918_1094, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:45,633 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:45,635 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009-1423786154320-soberoi-%5B99214C0970F243C192B41E0630470E0E%2F9633472D424B45F4-1423786185448-0-0-KILLED-root.soberoi-1423786161265.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1523467809_1
2015-02-12 16:09:45,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009-1423786154320-soberoi-%5B99214C0970F243C192B41E0630470E0E%2F9633472D424B45F4-1423786185448-0-0-KILLED-root.soberoi-1423786161265.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:45,640 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job_1423785972183_0009_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:45,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:09:45,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job_1423785972183_0009_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:45,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:09:45,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009/job_1423785972183_0009_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:45,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:09:45,676 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009_conf.xml_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW]]}
2015-02-12 16:09:45,680 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741919_1095 src: /127.0.0.1:61586 dest: /127.0.0.1:60511
2015-02-12 16:09:45,682 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741919_1095 src: /127.0.0.1:61587 dest: /127.0.0.1:60515
2015-02-12 16:09:45,684 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741919_1095 src: /127.0.0.1:61588 dest: /127.0.0.1:60521
2015-02-12 16:09:45,688 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61588, dest: /127.0.0.1:60521, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1523467809_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741919_1095, duration: 1790000
2015-02-12 16:09:45,688 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741919_1095, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:45,689 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:45,689 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61587, dest: /127.0.0.1:60515, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1523467809_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741919_1095, duration: 2584000
2015-02-12 16:09:45,689 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741919_1095, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:45,689 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:45,690 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61586, dest: /127.0.0.1:60511, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1523467809_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741919_1095, duration: 3851000
2015-02-12 16:09:45,690 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741919_1095, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:45,693 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|FINALIZED], ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:45,699 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1523467809_1
2015-02-12 16:09:45,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:45,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:45,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:45,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009-1423786154320-soberoi-%5B99214C0970F243C192B41E0630470E0E%2F9633472D424B45F4-1423786185448-0-0-KILLED-root.soberoi-1423786161265.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0009-1423786154320-soberoi-%5B99214C0970F243C192B41E0630470E0E%2F9633472D424B45F4-1423786185448-0-0-KILLED-root.soberoi-1423786161265.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:45,729 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423785972183_0009_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 16:09:45,729 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0009_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 16:09:45,729 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423785972183_0009 with final state: FINISHING
2015-02-12 16:09:45,729 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0009 State change from RUNNING to FINAL_SAVING
2015-02-12 16:09:45,729 INFO  recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423785972183_0009
2015-02-12 16:09:45,731 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0009_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 16:09:45,731 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0009 State change from FINAL_SAVING to FINISHING
2015-02-12 16:09:45,768 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4876358366_upper_C3CE3554252F4FBBABE677233BD1E8A2/_temporary/1/_temporary/attempt_1423785972183_0008_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:45,789 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0008_000001 (auth:SIMPLE)
2015-02-12 16:09:45,791 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0008_01_000004
2015-02-12 16:09:45,791 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000004
2015-02-12 16:09:45,791 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000004 transitioned from RUNNING to KILLING
2015-02-12 16:09:45,791 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0008_01_000004
2015-02-12 16:09:45,827 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0008_01_000004 is : 143
2015-02-12 16:09:45,848 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:45,849 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000004
2015-02-12 16:09:45,849 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000004
2015-02-12 16:09:45,849 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000004
2015-02-12 16:09:45,850 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000004
2015-02-12 16:09:45,851 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000004
2015-02-12 16:09:45,851 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:45,851 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0008_01_000004 from application application_1423785972183_0008
2015-02-12 16:09:45,852 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:45,852 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0008
2015-02-12 16:09:45,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4876358366_upper_C3CE3554252F4FBBABE677233BD1E8A2/_temporary/1/_temporary/attempt_1423785972183_0008_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:46,008 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0008_000001 (auth:SIMPLE)
2015-02-12 16:09:46,010 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0008_01_000006
2015-02-12 16:09:46,010 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000006
2015-02-12 16:09:46,010 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000006 transitioned from RUNNING to KILLING
2015-02-12 16:09:46,010 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:46,011 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0008_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 16:09:46,011 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000004
2015-02-12 16:09:46,011 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0008_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-02-12 16:09:46,011 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0008_000001 released container container_1423785972183_0008_01_000004 on node: host: 10.1.1.67:60568 #containers=2 available=1024 used=3072 with event: FINISHED
2015-02-12 16:09:46,011 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0008_01_000006
2015-02-12 16:09:46,035 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0008_01_000006 is : 143
2015-02-12 16:09:46,046 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:46,046 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000006
2015-02-12 16:09:46,047 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000006
2015-02-12 16:09:46,047 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000006
2015-02-12 16:09:46,047 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000006
2015-02-12 16:09:46,048 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000006
2015-02-12 16:09:46,048 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:46,049 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0008_01_000006 from application application_1423785972183_0008
2015-02-12 16:09:46,049 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:46,049 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0008
2015-02-12 16:09:46,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/6106191911_lower_551D4F93DDA94A689A0CB5809239257F/_temporary/1/_temporary/attempt_1423785972183_0009_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:46,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/6106191911_lower_551D4F93DDA94A689A0CB5809239257F/_temporary/1/_temporary/attempt_1423785972183_0009_m_000001_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:46,235 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/6106191911_lower_551D4F93DDA94A689A0CB5809239257F/_temporary/1/_temporary/attempt_1423785972183_0009_m_000003_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:46,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/6106191911_lower_551D4F93DDA94A689A0CB5809239257F/_temporary/1/_temporary/attempt_1423785972183_0009_m_000004_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:46,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/6106191911_lower_551D4F93DDA94A689A0CB5809239257F/_temporary/1/_temporary/attempt_1423785972183_0009_m_000000_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:46,377 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:46,377 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0009_01_000002 in state: COMPLETED event:FINISHED
2015-02-12 16:09:46,377 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000002
2015-02-12 16:09:46,377 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0009_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 16:09:46,377 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0009_000001 released container container_1423785972183_0009_01_000002 on node: host: 10.1.1.67:60556 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 16:09:46,386 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:46,386 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:46,386 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0009_01_000004 in state: COMPLETED event:FINISHED
2015-02-12 16:09:46,386 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000004
2015-02-12 16:09:46,386 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0009_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 16:09:46,386 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0009_000001 released container container_1423785972183_0009_01_000004 on node: host: 10.1.1.67:60560 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 16:09:46,402 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:46,402 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0009_01_000003 in state: COMPLETED event:FINISHED
2015-02-12 16:09:46,402 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000003
2015-02-12 16:09:46,402 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0009_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-02-12 16:09:46,402 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0009_000001 released container container_1423785972183_0009_01_000003 on node: host: 10.1.1.67:60564 #containers=2 available=2048 used=2048 with event: FINISHED
2015-02-12 16:09:46,402 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:46,402 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0009_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 16:09:46,402 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000005
2015-02-12 16:09:46,403 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0009_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 16:09:46,403 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0009_000001 released container container_1423785972183_0009_01_000005 on node: host: 10.1.1.67:60564 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 16:09:46,403 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0009_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:46,403 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0009_01_000007 in state: COMPLETED event:FINISHED
2015-02-12 16:09:46,403 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0009	CONTAINERID=container_1423785972183_0009_01_000007
2015-02-12 16:09:46,403 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0009_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60564, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 16:09:46,403 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0009_000001 released container container_1423785972183_0009_01_000007 on node: host: 10.1.1.67:60564 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 16:09:46,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4876358366_upper_C3CE3554252F4FBBABE677233BD1E8A2/_temporary/1/_temporary/attempt_1423785972183_0008_m_000002_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:46,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4876358366_upper_C3CE3554252F4FBBABE677233BD1E8A2/_temporary/1/_temporary/attempt_1423785972183_0008_m_000004_0	dst=null	perm=null	proto=rpc
2015-02-12 16:09:46,571 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0008_000001 (auth:SIMPLE)
2015-02-12 16:09:46,573 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0008_01_000005
2015-02-12 16:09:46,574 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000005
2015-02-12 16:09:46,574 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000005 transitioned from RUNNING to KILLING
2015-02-12 16:09:46,574 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0008_01_000005
2015-02-12 16:09:46,575 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:46,583 INFO  ipc.Server (Server.java:saslProcess(1294)) - Auth successful for appattempt_1423785972183_0008_000001 (auth:SIMPLE)
2015-02-12 16:09:46,587 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(932)) - Stopping container with container Id: container_1423785972183_0008_01_000008
2015-02-12 16:09:46,588 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.67	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000008
2015-02-12 16:09:46,588 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:46,600 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0008_01_000005 is : 143
2015-02-12 16:09:46,614 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000008 transitioned from RUNNING to KILLING
2015-02-12 16:09:46,614 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:46,614 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(367)) - Cleaning up container container_1423785972183_0008_01_000008
2015-02-12 16:09:46,636 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(209)) - Exit code from container container_1423785972183_0008_01_000008 is : 143
2015-02-12 16:09:46,652 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000005
2015-02-12 16:09:46,653 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000005
2015-02-12 16:09:46,652 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000005
2015-02-12 16:09:46,654 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000005
2015-02-12 16:09:46,659 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-02-12 16:09:46,659 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000005
2015-02-12 16:09:46,660 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:46,660 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000008
2015-02-12 16:09:46,661 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000008
2015-02-12 16:09:46,661 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000008
2015-02-12 16:09:46,662 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(421)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1423785972183_0008/container_1423785972183_0008_01_000008
2015-02-12 16:09:46,662 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0008_01_000005 from application application_1423785972183_0008
2015-02-12 16:09:46,663 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:46,663 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0008
2015-02-12 16:09:46,664 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000008
2015-02-12 16:09:46,664 INFO  container.Container (ContainerImpl.java:handle(1010)) - Container container_1423785972183_0008_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-02-12 16:09:46,665 INFO  application.Application (ApplicationImpl.java:transition(341)) - Removing container_1423785972183_0008_01_000008 from application application_1423785972183_0008
2015-02-12 16:09:46,665 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(168)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-02-12 16:09:46,665 INFO  containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_STOP for appId application_1423785972183_0008
2015-02-12 16:09:46,747 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423785972183_0009 unregistered successfully. 
2015-02-12 16:09:46,752 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741904_1080 127.0.0.1:60518 127.0.0.1:60521 127.0.0.1:60515 127.0.0.1:60511 
2015-02-12 16:09:46,753 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741906_1082 127.0.0.1:60511 127.0.0.1:60521 127.0.0.1:60518 127.0.0.1:60515 
2015-02-12 16:09:46,753 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741908_1084 127.0.0.1:60515 127.0.0.1:60511 127.0.0.1:60521 
2015-02-12 16:09:46,753 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741910_1086 127.0.0.1:60521 127.0.0.1:60511 127.0.0.1:60515 
2015-02-12 16:09:46,753 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741914_1090 127.0.0.1:60518 127.0.0.1:60521 127.0.0.1:60511 
2015-02-12 16:09:46,753 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741916_1092 127.0.0.1:60518 127.0.0.1:60511 127.0.0.1:60521 
2015-02-12 16:09:46,754 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741913_1089 127.0.0.1:60518 127.0.0.1:60511 127.0.0.1:60515 
2015-02-12 16:09:46,754 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0009	dst=null	perm=null	proto=rpc
2015-02-12 16:09:47,019 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:47,020 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:47,020 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0008_01_000006 in state: COMPLETED event:FINISHED
2015-02-12 16:09:47,020 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000006
2015-02-12 16:09:47,020 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0008_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60568, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-02-12 16:09:47,021 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0008_000001 released container container_1423785972183_0008_01_000006 on node: host: 10.1.1.67:60568 #containers=1 available=2048 used=2048 with event: FINISHED
2015-02-12 16:09:47,356 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (1/3)
2015-02-12 16:09:47,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/4876358366_upper_C3CE3554252F4FBBABE677233BD1E8A2/_temporary	dst=null	perm=null	proto=rpc
2015-02-12 16:09:47,381 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61567, dest: /127.0.0.1:60511, bytes: 48204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1999320594_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741915_1091, duration: 2080798000
2015-02-12 16:09:47,382 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741915_1091, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:47,382 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 16338
2015-02-12 16:09:47,383 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61566, dest: /127.0.0.1:60521, bytes: 48204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1999320594_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741915_1091, duration: 2081378000
2015-02-12 16:09:47,383 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741915_1091, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:47,383 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 16338
2015-02-12 16:09:47,384 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61565, dest: /127.0.0.1:60515, bytes: 48204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1999320594_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741915_1091, duration: 2083282000
2015-02-12 16:09:47,385 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741915_1091, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:47,385 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 16338
2015-02-12 16:09:47,386 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job_1423785972183_0008_1.jhist is closed by DFSClient_NONMAPREDUCE_1999320594_1
2015-02-12 16:09:47,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:09:47,390 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008.summary_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]}
2015-02-12 16:09:47,393 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741920_1096 src: /127.0.0.1:61600 dest: /127.0.0.1:60515
2015-02-12 16:09:47,394 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0008_01_000003]
2015-02-12 16:09:47,395 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:47,395 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:47,396 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000010 Container Transitioned from NEW to ALLOCATED
2015-02-12 16:09:47,396 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000010
2015-02-12 16:09:47,396 INFO  scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(141)) - Assigned container container_1423785972183_0008_01_000010 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60560, which has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available after allocation
2015-02-12 16:09:47,396 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741920_1096 src: /127.0.0.1:61601 dest: /127.0.0.1:60521
2015-02-12 16:09:47,398 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741920_1096 src: /127.0.0.1:61602 dest: /127.0.0.1:60518
2015-02-12 16:09:47,402 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61602, dest: /127.0.0.1:60518, bytes: 412, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1999320594_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741920_1096, duration: 2412000
2015-02-12 16:09:47,402 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741920_1096, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:47,403 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61601, dest: /127.0.0.1:60521, bytes: 412, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1999320594_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741920_1096, duration: 3526000
2015-02-12 16:09:47,403 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741920_1096, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:47,404 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61600, dest: /127.0.0.1:60515, bytes: 412, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1999320594_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741920_1096, duration: 4630000
2015-02-12 16:09:47,405 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741920_1096, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:47,405 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]} size 0
2015-02-12 16:09:47,406 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aef69666-7400-49ed-afe1-288ce86bb4ec:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-ab5fa156-eb3d-450f-a7f7-623cd0854d83:NORMAL|RBW]]} size 0
2015-02-12 16:09:47,407 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741920_1096 size 412
2015-02-12 16:09:47,407 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008.summary_tmp is closed by DFSClient_NONMAPREDUCE_1999320594_1
2015-02-12 16:09:47,410 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:47,411 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:47,411 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:47,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:47,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job_1423785972183_0008_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:09:47,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008-1423786154301-soberoi-%5B99214C0970F243C192B41E0630470E0E%2F33F1C222731E4C5C-1423786187364-5-0-KILLED-root.soberoi-1423786161058.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:09:47,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job_1423785972183_0008_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:09:47,424 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008-1423786154301-soberoi-%5B99214C0970F243C192B41E0630470E0E%2F33F1C222731E4C5C-1423786187364-5-0-KILLED-root.soberoi-1423786161058.jhist_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:09:47,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job_1423785972183_0008_1.jhist	dst=null	perm=null	proto=rpc
2015-02-12 16:09:47,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008-1423786154301-soberoi-%5B99214C0970F243C192B41E0630470E0E%2F33F1C222731E4C5C-1423786187364-5-0-KILLED-root.soberoi-1423786161058.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:09:47,436 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008-1423786154301-soberoi-%5B99214C0970F243C192B41E0630470E0E%2F33F1C222731E4C5C-1423786187364-5-0-KILLED-root.soberoi-1423786161058.jhist_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:09:47,438 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741921_1097 src: /127.0.0.1:61604 dest: /127.0.0.1:60518
2015-02-12 16:09:47,440 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741921_1097 src: /127.0.0.1:61605 dest: /127.0.0.1:60521
2015-02-12 16:09:47,441 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741921_1097 src: /127.0.0.1:61606 dest: /127.0.0.1:60511
2015-02-12 16:09:47,444 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61606, dest: /127.0.0.1:60511, bytes: 48204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1999320594_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741921_1097, duration: 1497000
2015-02-12 16:09:47,444 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741921_1097, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:47,445 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 0
2015-02-12 16:09:47,446 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61605, dest: /127.0.0.1:60521, bytes: 48204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1999320594_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741921_1097, duration: 2653000
2015-02-12 16:09:47,446 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741921_1097, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:47,446 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 0
2015-02-12 16:09:47,447 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61604, dest: /127.0.0.1:60518, bytes: 48204, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1999320594_1, offset: 0, srvID: 1309dd03-96de-4536-9ff7-96af7fbd7a36, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741921_1097, duration: 4531000
2015-02-12 16:09:47,447 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741921_1097, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:47,448 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60518 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9cfcf886-f454-4dc2-a9ec-9e1be22af862:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-b4d70e9e-0385-4907-87b1-da33b47a75ae:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]} size 0
2015-02-12 16:09:47,450 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008-1423786154301-soberoi-%5B99214C0970F243C192B41E0630470E0E%2F33F1C222731E4C5C-1423786187364-5-0-KILLED-root.soberoi-1423786161058.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1999320594_1
2015-02-12 16:09:47,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008-1423786154301-soberoi-%5B99214C0970F243C192B41E0630470E0E%2F33F1C222731E4C5C-1423786187364-5-0-KILLED-root.soberoi-1423786161058.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:47,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job_1423785972183_0008_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:47,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:09:47,455 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job_1423785972183_0008_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:47,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008_conf.xml_tmp	dst=null	perm=null	proto=rpc
2015-02-12 16:09:47,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008/job_1423785972183_0008_1_conf.xml	dst=null	perm=null	proto=rpc
2015-02-12 16:09:47,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-	proto=rpc
2015-02-12 16:09:47,466 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(3501)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008_conf.xml_tmp. BP-2102022600-10.1.1.67-1423785955551 blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-fa825ea8-1a31-4ac1-b7d7-b25f0961124b:NORMAL|RBW]]}
2015-02-12 16:09:47,468 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741922_1098 src: /127.0.0.1:61608 dest: /127.0.0.1:60515
2015-02-12 16:09:47,469 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741922_1098 src: /127.0.0.1:61609 dest: /127.0.0.1:60521
2015-02-12 16:09:47,470 INFO  datanode.DataNode (DataXceiver.java:writeBlock(585)) - Receiving BP-2102022600-10.1.1.67-1423785955551:blk_1073741922_1098 src: /127.0.0.1:61610 dest: /127.0.0.1:60511
2015-02-12 16:09:47,473 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61610, dest: /127.0.0.1:60511, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1999320594_1, offset: 0, srvID: 82d30123-0426-431b-a65c-18a9266604fb, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741922_1098, duration: 1992000
2015-02-12 16:09:47,474 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741922_1098, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-02-12 16:09:47,474 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60511 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:47,474 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61609, dest: /127.0.0.1:60521, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1999320594_1, offset: 0, srvID: ea98f7fc-75be-4946-bca6-e0b6950404d2, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741922_1098, duration: 2549000
2015-02-12 16:09:47,475 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741922_1098, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:47,475 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60521 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:47,475 INFO  DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1300)) - src: /127.0.0.1:61608, dest: /127.0.0.1:60515, bytes: 113223, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1999320594_1, offset: 0, srvID: 3ba35078-bb62-4777-80dc-a38267fd3486, blockid: BP-2102022600-10.1.1.67-1423785955551:blk_1073741922_1098, duration: 3509000
2015-02-12 16:09:47,476 INFO  datanode.DataNode (BlockReceiver.java:run(1281)) - PacketResponder: BP-2102022600-10.1.1.67-1423785955551:blk_1073741922_1098, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-02-12 16:09:47,476 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2418)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60515 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-26db9770-c66e-4f1e-9665-2320edc75e9f:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-5f2bc4c2-e139-4aaf-be70-e525472a223d:NORMAL|RBW], ReplicaUnderConstruction[[DISK]DS-f7297be7-9980-4b60-83f2-b0bd169e434b:NORMAL|FINALIZED]]} size 0
2015-02-12 16:09:47,477 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(3422)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1999320594_1
2015-02-12 16:09:47,479 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:47,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008.summary	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:47,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008_conf.xml	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:47,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008-1423786154301-soberoi-%5B99214C0970F243C192B41E0630470E0E%2F33F1C222731E4C5C-1423786187364-5-0-KILLED-root.soberoi-1423786161058.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1423785972183_0008-1423786154301-soberoi-%5B99214C0970F243C192B41E0630470E0E%2F33F1C222731E4C5C-1423786187364-5-0-KILLED-root.soberoi-1423786161058.jhist	perm=soberoi:supergroup:rwxrwx---	proto=rpc
2015-02-12 16:09:47,499 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1122)) - Updating application attempt appattempt_1423785972183_0008_000001 with final state: FINISHING, and exit status: -1000
2015-02-12 16:09:47,499 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0008_000001 State change from RUNNING to FINAL_SAVING
2015-02-12 16:09:47,499 INFO  rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(987)) - Updating application application_1423785972183_0008 with final state: FINISHING
2015-02-12 16:09:47,500 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0008 State change from RUNNING to FINAL_SAVING
2015-02-12 16:09:47,500 INFO  recovery.RMStateStore (RMStateStore.java:transition(160)) - Updating info for app: application_1423785972183_0008
2015-02-12 16:09:47,500 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(767)) - appattempt_1423785972183_0008_000001 State change from FINAL_SAVING to FINISHING
2015-02-12 16:09:47,500 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(711)) - application_1423785972183_0008 State change from FINAL_SAVING to FINISHING
2015-02-12 16:09:47,596 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:47,596 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0008_01_000005 in state: COMPLETED event:FINISHED
2015-02-12 16:09:47,596 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000005
2015-02-12 16:09:47,597 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0008_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-02-12 16:09:47,597 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0008_000001 released container container_1423785972183_0008_01_000005 on node: host: 10.1.1.67:60556 #containers=1 available=3072 used=1024 with event: FINISHED
2015-02-12 16:09:47,597 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(378)) - container_1423785972183_0008_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-02-12 16:09:47,597 INFO  fair.FSAppAttempt (FSAppAttempt.java:containerCompleted(132)) - Completed container: container_1423785972183_0008_01_000008 in state: COMPLETED event:FINISHED
2015-02-12 16:09:47,597 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(101)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1423785972183_0008	CONTAINERID=container_1423785972183_0008_01_000008
2015-02-12 16:09:47,597 INFO  scheduler.SchedulerNode (SchedulerNode.java:releaseContainer(204)) - Released container container_1423785972183_0008_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.67:60556, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-02-12 16:09:47,597 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(824)) - Application attempt appattempt_1423785972183_0008_000001 released container container_1423785972183_0008_01_000008 on node: host: 10.1.1.67:60556 #containers=0 available=4096 used=0 with event: FINISHED
2015-02-12 16:09:47,597 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:47,961 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60521 to delete [blk_1073741904_1080, blk_1073741906_1082, blk_1073741908_1084, blk_1073741910_1086, blk_1073741914_1090, blk_1073741916_1092]
2015-02-12 16:09:47,961 INFO  hdfs.StateChange (BlockManager.java:invalidateWorkForOneNode(3338)) - BLOCK* BlockManager: ask 127.0.0.1:60515 to delete [blk_1073741904_1080, blk_1073741906_1082, blk_1073741908_1084, blk_1073741910_1086, blk_1073741913_1089]
2015-02-12 16:09:48,024 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(470)) - Removed completed containers from NM context: [container_1423785972183_0008_01_000004]
2015-02-12 16:09:48,024 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:48,024 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:48,404 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:48,418 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:48,418 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:48,418 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:48,508 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:finishApplicationMaster(348)) - application_1423785972183_0008 unregistered successfully. 
2015-02-12 16:09:48,511 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741903_1079 127.0.0.1:60521 127.0.0.1:60511 127.0.0.1:60515 127.0.0.1:60518 
2015-02-12 16:09:48,511 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741905_1081 127.0.0.1:60518 127.0.0.1:60511 127.0.0.1:60521 127.0.0.1:60515 
2015-02-12 16:09:48,512 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741907_1083 127.0.0.1:60518 127.0.0.1:60511 127.0.0.1:60521 
2015-02-12 16:09:48,512 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741909_1085 127.0.0.1:60515 127.0.0.1:60518 127.0.0.1:60511 
2015-02-12 16:09:48,512 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741912_1088 127.0.0.1:60518 127.0.0.1:60515 127.0.0.1:60511 
2015-02-12 16:09:48,512 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741915_1091 127.0.0.1:60515 127.0.0.1:60521 127.0.0.1:60511 
2015-02-12 16:09:48,513 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1076)) - BLOCK* addToInvalidates: blk_1073741911_1087 127.0.0.1:60521 127.0.0.1:60518 127.0.0.1:60511 
2015-02-12 16:09:48,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1423785972183_0008	dst=null	perm=null	proto=rpc
2015-02-12 16:09:48,598 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:48,598 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:48,598 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:48,808 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741904 for deletion
2015-02-12 16:09:48,808 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741906 for deletion
2015-02-12 16:09:48,808 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741908 for deletion
2015-02-12 16:09:48,809 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741904
2015-02-12 16:09:48,809 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741910 for deletion
2015-02-12 16:09:48,809 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741908
2015-02-12 16:09:48,809 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data4/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741906
2015-02-12 16:09:48,809 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741913 for deletion
2015-02-12 16:09:48,810 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741910
2015-02-12 16:09:48,810 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data3/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741913
2015-02-12 16:09:49,026 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:49,377 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] stopped all jobs
2015-02-12 16:09:49,378 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] shutting down job executor
2015-02-12 16:09:49,405 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] abandoning step: (3/3) ...platform/STOPPING/stopped, predecessor failed: (1/3)
2015-02-12 16:09:49,405 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (3/3) ...platform/STOPPING/stopped
2015-02-12 16:09:49,405 WARN  flow.FlowStep (BaseFlowStep.java:logWarn(839)) - [lower*upper] abandoning step: (3/3) ...platform/STOPPING/stopped, predecessor failed: (2/3)
2015-02-12 16:09:49,405 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] stopping: (3/3) ...platform/STOPPING/stopped
2015-02-12 16:09:49,405 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] shutdown complete
2015-02-12 16:09:49,406 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/flowplatform/STOPPING/stopped
2015-02-12 16:09:49,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/STOPPING/stopped	dst=null	perm=null	proto=rpc
2015-02-12 16:09:49,414 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:49,420 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 16:09:49,420 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 16:09:49,425 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:49,425 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:49,425 INFO  fair.FairScheduler (FairScheduler.java:completedContainer(795)) - Null container completed...
2015-02-12 16:09:49,426 INFO  hadoop.Hfs (Hfs.java:makeLocal(507)) - forcing job to local mode, via sink: Lfs["TextLine[['offset', 'line']->[ALL]]"]["output/path"]
2015-02-12 16:09:49,438 INFO  hadoop.Hfs (Hfs.java:makeLocal(507)) - forcing job to local mode, via sink: Lfs["TextLine[['offset', 'line']->[ALL]]"]["output/path"]
2015-02-12 16:09:49,451 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 16:09:49,451 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 16:09:49,488 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 16:09:49,488 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 16:09:49,492 INFO  hadoop.Hfs (Hfs.java:makeLocal(507)) - forcing job to local mode, via source: Lfs["TextLine[['offset', 'line']->[ALL]]"]["input/path"]
2015-02-12 16:09:49,505 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 16:09:49,506 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 16:09:49,511 INFO  hadoop.Hfs (Hfs.java:makeLocal(507)) - forcing job to local mode, via source: Lfs["TextLine[['offset', 'line']->[ALL]]"]["input/path"]
2015-02-12 16:09:49,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/classes/test/data/lower.txt	dst=null	perm=null	proto=rpc
2015-02-12 16:09:49,527 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741904 for deletion
2015-02-12 16:09:49,528 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741906 for deletion
2015-02-12 16:09:49,528 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741908 for deletion
2015-02-12 16:09:49,528 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741910 for deletion
2015-02-12 16:09:49,528 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741914 for deletion
2015-02-12 16:09:49,528 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(205)) - Scheduling blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741916 for deletion
2015-02-12 16:09:49,529 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741904
2015-02-12 16:09:49,529 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741906
2015-02-12 16:09:49,529 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data7/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741908
2015-02-12 16:09:49,529 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741910
2015-02-12 16:09:49,530 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741914
2015-02-12 16:09:49,530 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(281)) - Deleted BP-2102022600-10.1.1.67-1423785955551 blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/data/dfs/data/data8/current/BP-2102022600-10.1.1.67-1423785955551/current/finalized/subdir0/subdir0/blk_1073741916
2015-02-12 16:09:49,537 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-02-12 16:09:49,537 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-02-12 16:09:49,551 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output//hadoop2-mr1/flowplatform/badserialization
2015-02-12 16:09:49,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditMessage(9088)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/cloudera/build/test/output/hadoop2-mr1/flowplatform/badserialization	dst=null	perm=null	proto=rpc

Standard error

Feb 12, 2015 4:06:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class
Feb 12, 2015 4:06:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class
Feb 12, 2015 4:06:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Feb 12, 2015 4:06:12 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Feb 12, 2015 4:06:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Feb 12, 2015 4:06:12 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Feb 12, 2015 4:06:13 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest"
Feb 12, 2015 4:06:13 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Feb 12, 2015 4:06:13 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
Feb 12, 2015 4:06:13 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
Feb 12, 2015 4:06:13 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Feb 12, 2015 4:06:13 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Feb 12, 2015 4:06:13 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Feb 12, 2015 4:06:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Feb 12, 2015 4:06:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Feb 12, 2015 4:06:14 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Feb 12, 2015 4:06:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Feb 12, 2015 4:06:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Feb 12, 2015 4:06:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Feb 12, 2015 4:06:14 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Feb 12, 2015 4:06:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Feb 12, 2015 4:06:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Feb 12, 2015 4:06:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Feb 12, 2015 4:06:14 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Feb 12, 2015 4:06:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Feb 12, 2015 4:06:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Feb 12, 2015 4:06:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Feb 12, 2015 4:06:15 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Feb 12, 2015 4:06:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Feb 12, 2015 4:06:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Feb 12, 2015 4:06:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Feb 12, 2015 4:06:15 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Feb 12, 2015 4:06:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Feb 12, 2015 4:06:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Feb 12, 2015 4:06:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Feb 12, 2015 4:06:16 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Feb 12, 2015 4:06:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Feb 12, 2015 4:06:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Feb 12, 2015 4:06:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Feb 12, 2015 4:06:16 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.